2018-12-27
§
|
19:31 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays), take #3 (duration: 25m 49s) |
[production] |
19:05 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays), take #3 |
[production] |
18:15 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays), take #2 |
[production] |
18:15 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays) - T212631 (duration: 11m 20s) |
[production] |
18:04 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays) - T212631 |
[production] |
18:04 |
<mobrovac@deploy1001> |
deploy aborted: Fix rate-limiter crash (with increased deploy delays) - T212631 (duration: 00m 09s) |
[production] |
18:04 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@a67f38e]: Fix rate-limiter crash (with increased deploy delays) - T212631 |
[production] |
18:03 |
<mobrovac@deploy1001> |
deploy aborted: Fix rate-limiter crash - T212631 (duration: 13m 09s) |
[production] |
17:50 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@70c4752]: Fix rate-limiter crash - T212631 |
[production] |
17:20 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@ae7a537]: Fix rate-limiter crash - T212631 - deploy only on canary restbase1007 (duration: 04m 24s) |
[production] |
17:15 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@ae7a537]: Fix rate-limiter crash - T212631 - deploy only on canary restbase1007 |
[production] |
16:00 |
<cmjohnson1> |
powercycling frdb1001 for troubleshooting |
[production] |
15:21 |
<bawolff> |
Updated interwiki cache https://biblio.wiki to https://wikilivres.org -> T212650 |
[production] |
15:19 |
<bawolff@deploy1001> |
Synchronized wmf-config/interwiki.php: Updating interwiki cache (duration: 03m 34s) |
[production] |
2018-12-21
§
|
21:29 |
<mutante> |
phab1002 - temp hack to unbreak phd / systemd alert, real fix will be phab deployment to new server |
[production] |
21:28 |
<mutante> |
phab1002 - mkdir -p /srv/phab/libext/ava/src ; touch __phutil_library_init__.php |
[production] |
21:05 |
<mutante> |
phab1002 - apt autoremove |
[production] |
21:04 |
<mutante> |
phab1002 - removing all php related packages and letting puppet reinstall them |
[production] |
20:38 |
<mutante> |
phab1002 - restart php-fpm, restart phd for testing. phd fails |
[production] |
18:50 |
<mutante> |
[scb1001:~] $ sudo systemctl restart pdfrender |
[production] |
14:20 |
<dcausse> |
elastic@eqiad deleting unused index enwiki_general_1537906513 |
[production] |
13:24 |
<moritzm> |
installing subversion updates from stretch point release |
[production] |
12:34 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: T211494 (duration: 00m 44s) |
[production] |
12:31 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T211494 (duration: 00m 45s) |
[production] |
12:10 |
<moritzm> |
rebooting url downloaders to pick up SSBD-enabled QEMU |
[production] |
11:38 |
<moritzm> |
rebooting debug proxies to pick up SSBD-enabled QEMU |
[production] |
09:58 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=ms-fe2006.codfw.wmnet |
[production] |
09:57 |
<ema> |
repool ms-fe2006 with old certs, test successful T212215#4839960 |
[production] |
09:23 |
<ema@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=ms-fe2006.codfw.wmnet |
[production] |
09:22 |
<ema> |
depool ms-fe2006 to test new TLS certs T212215 |
[production] |
08:45 |
<moritzm> |
upgrading nginx on sodium |
[production] |