|
2021-11-03
ยง
|
| 16:04 |
<mmandere@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp4033.ulsfo.wmnet with OS buster |
[production] |
| 15:59 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mathoid' for release 'staging' . |
[production] |
| 15:58 |
<mmandere> |
depool cp4033.ulsfo.wmnet - T290694 |
[production] |
| 15:57 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'linkrecommendation' for release 'staging' . |
[production] |
| 15:51 |
<hnowlan> |
rolling restart-php7.2-fpm on A:mw-api-codfw to pick up wikidiff2 upgrade |
[production] |
| 15:47 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventstreams-internal' for release 'main' . |
[production] |
| 15:22 |
<ppchelko@deploy1002> |
Finished deploy [restbase/deploy@664a2f8]: Add new wikis T292422 T294587 T294588 (duration: 00m 36s) |
[production] |
| 15:22 |
<ppchelko@deploy1002> |
Started deploy [restbase/deploy@664a2f8]: Add new wikis T292422 T294587 T294588 |
[production] |
| 15:21 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 15:21 |
<ppchelko@deploy1002> |
Started deploy [restbase/deploy@664a2f8]: Add new wikis T292422 T294587 T294588 |
[production] |
| 15:21 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 15:11 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventstreams' for release 'production' . |
[production] |
| 15:10 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . |
[production] |
| 15:10 |
<jmm@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2001.codfw.wmnet |
[production] |
| 15:09 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-logging-external' for release 'production' . |
[production] |
| 15:08 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . |
[production] |
| 15:06 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'production' . |
[production] |
| 15:06 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'eventgate-analytics' for release 'canary' . |
[production] |
| 15:05 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host ganeti-test2001.codfw.wmnet |
[production] |
| 14:54 |
<elukey@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'api-gateway' for release 'production' . |
[production] |
| 14:40 |
<moritzm> |
installing elfutils security updates on stretch |
[production] |
| 14:37 |
<elukey@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . |
[production] |
| 14:37 |
<elukey@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'api-gateway' for release 'production' . |
[production] |
| 14:33 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'echostore' for release 'staging' . |
[production] |
| 14:32 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . |
[production] |
| 14:31 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'citoid' for release 'staging' . |
[production] |
| 14:31 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
| 14:30 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 14:21 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'api-gateway' for release 'staging' . |
[production] |
| 14:20 |
<hnowlan> |
rolling restart-php7.2-fpm on A:mw-eqiad and A:mw-api-eqiad |
[production] |
| 14:17 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'apertium' for release 'staging' . |
[production] |
| 14:16 |
<hnowlan> |
deploying wikidiff2-1.13.0-1 to A:mw-eqiad and A:mw-api-eqiad |
[production] |
| 14:13 |
<moritzm> |
installing remaining tiff security updates for buster |
[production] |
| 14:10 |
<moritzm> |
initialising ganeti-test01.svc.codfw.wmnet cluster on ganeti-test2001 T286206 |
[production] |
| 14:07 |
<XioNoX> |
move cr2-codfw access switches link to working linecard - T289241 |
[production] |
| 14:04 |
<vgutierrez> |
update eqsin and ulsfo cp instances to ATS 8.0.8-1wm5 - T294897 |
[production] |
| 13:38 |
<jelto@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . |
[production] |
| 13:34 |
<bblack@cumin1001> |
conftool action : set/pooled=no; selector: name=cp403[3456].*,service=ats-be |
[production] |
| 13:34 |
<bblack> |
cp403[3456] - depool ats-be service (upcoming re-reimage) |
[production] |
| 12:33 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:29 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:21 |
<vgutierrez> |
update trafficserver on cp4027 to 8.0.8-1wm5 - T294897 |
[production] |
| 12:20 |
<vgutierrez> |
update trafficserver on cp4021 to 8.0.8-1wm5 - T294897 |
[production] |
| 12:19 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:18 |
<vgutierrez> |
upload trafficserver 8.0.8-1wm5 to apt.wm.org (buster) - T294897 |
[production] |
| 12:16 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:15 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 9ca753bf4b7afea41c29225d4f32e3ba01bf7c30: Revert "Adjust AF config for ukwiki" (T272330) (duration: 01m 03s) |
[production] |
| 12:13 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 667ef0b6e9e8d1d70061cc904ce49e7632300b75: foundationwiki: Increase AF throttle requirements (duration: 01m 13s) |
[production] |
| 11:58 |
<hnowlan> |
rolling restart-php7.2-fpm on A:mw-codfw and A:mw-api-codfw |
[production] |
| 11:56 |
<hnowlan> |
deploying wikidiff2-1.13.0-1 to A:mw-codfw and A:mw-api-codfw |
[production] |