|
2025-12-05
§
|
| 02:11 |
<ladsgroup@cumin1003> |
dbctl commit (dc=all): 'Repooling after maintenance db1166 (T410589)', diff saved to https://phabricator.wikimedia.org/P86413 and previous config saved to /var/cache/conftool/dbconfig/20251205-021123-ladsgroup.json |
[production] |
| 02:09 |
<wfan> |
donorwiki upgraded from 053b3f88 to 9ab44e85 |
[production] |
| 02:07 |
<wfan> |
payments-wiki upgraded from d2799b95 to 9ab44e85 |
[production] |
| 02:01 |
<rzl> |
rzl@apt1002:~$ sudo -i reprepro -C component/envoy-future include bullseye-wikimedia /home/rzl/envoyproxy_1.35.7-1_amd64.changes |
[production] |
| 01:44 |
<wfan> |
SmashPig upgraded from a25fbb28 to 1442d0a0 |
[production] |
| 01:41 |
<eileen> |
civicrm upgraded from d4bd9b1b to 36b09796 |
[production] |
| 01:13 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 13m 06s) |
[production] |
| 01:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 00:27 |
<Amir1> |
ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki huwikiquote --mark "Corrupted UTF-8 (T351953)" --revisions 3804,3808,3811,3813,3814,3818,3825 |
[production] |
| 00:26 |
<Amir1> |
ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki guwiktionary --mark "Corrupted UTF-8 (T351953)" --revisions 20576 |
[production] |
|
2025-12-04
§
|
| 23:47 |
<tzatziki> |
removing 4 files for legal compliance |
[production] |
| 23:34 |
<tzatziki> |
removing 2 files for legal compliance |
[production] |
| 23:23 |
<tzatziki> |
removing 3 files for legal compliance |
[production] |
| 23:16 |
<ryankemper@cumin2002> |
END (PASS) - Cookbook sre.hadoop.reboot-workers (exit_code=0) for Hadoop test cluster |
[production] |
| 23:16 |
<tzatziki> |
removing 5 files for legal compliance |
[production] |
| 23:04 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy7002.magru.wmnet |
[production] |
| 23:02 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy7001.magru.wmnet |
[production] |
| 23:00 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy7002.magru.wmnet |
[production] |
| 23:00 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy6002.drmrs.wmnet |
[production] |
| 22:59 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy6001.drmrs.wmnet |
[production] |
| 22:59 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy5002.eqsin.wmnet |
[production] |
| 22:58 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy7001.magru.wmnet |
[production] |
| 22:56 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy5001.eqsin.wmnet |
[production] |
| 22:56 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy6002.drmrs.wmnet |
[production] |
| 22:55 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy6001.drmrs.wmnet |
[production] |
| 22:55 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy5002.eqsin.wmnet |
[production] |
| 22:55 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3002.esams.wmnet |
[production] |
| 22:55 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy4002.ulsfo.wmnet |
[production] |
| 22:52 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3001.esams.wmnet |
[production] |
| 22:52 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy5001.eqsin.wmnet |
[production] |
| 22:51 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy2002.codfw.wmnet |
[production] |
| 22:51 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy4002.ulsfo.wmnet |
[production] |
| 22:51 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy3002.esams.wmnet |
[production] |
| 22:51 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy4001.ulsfo.wmnet |
[production] |
| 22:51 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy2001.codfw.wmnet |
[production] |
| 22:50 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy4001.ulsfo.wmnet |
[production] |
| 22:50 |
<dzahn@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy1002.eqiad.wmnet |
[production] |
| 22:49 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy3001.esams.wmnet |
[production] |
| 22:48 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy2002.codfw.wmnet |
[production] |
| 22:47 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy2001.codfw.wmnet |
[production] |
| 22:46 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host tcp-proxy1002.eqiad.wmnet |
[production] |
| 22:42 |
<dzahn@cumin2002> |
END (FAIL) - Cookbook sre.hosts.reboot-cluster (exit_code=99) |
[production] |
| 22:42 |
<dzahn@cumin2002> |
START - Cookbook sre.hosts.reboot-cluster |
[production] |
| 22:37 |
<sbassett> |
Deployed security fix for T409226 |
[production] |
| 22:35 |
<ryankemper@cumin2002> |
START - Cookbook sre.hadoop.reboot-workers for Hadoop test cluster |
[production] |
| 22:28 |
<sbassett> |
Deployed security fix for T408135 |
[production] |
| 22:22 |
<dzahn@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 14 hosts with reason: T408532 |
[production] |
| 22:20 |
<ryankemper> |
T411568 Rebooting `stat*` |
[production] |
| 22:11 |
<ryankemper@cumin2002> |
DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on stat[1008-1011].eqiad.wmnet with reason: T411568 |
[production] |
| 22:06 |
<cscott@deploy2002> |
Finished scap sync-world: Backport for [[gerrit:1215115|Activate postprocessing cache on testwiki, test2wiki, officewiki (T348255)]] (duration: 14m 23s) |
[production] |