1-50 of 10000 results (25ms)
2025-12-05 §
09:16 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) db1233 - Depool db1233.eqiad.wmnet to then clone it to db1229.eqiad.wmnet - fceratto@cumin1003 [production]
09:16 <fceratto@cumin1003> START - Cookbook sre.mysql.depool db1233 - Depool db1233.eqiad.wmnet to then clone it to db1229.eqiad.wmnet - fceratto@cumin1003 [production]
09:16 <fceratto@cumin1003> START - Cookbook sre.mysql.clone of db1233.eqiad.wmnet onto db1229.eqiad.wmnet [production]
08:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply [production]
08:03 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply [production]
08:02 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply [production]
08:02 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply [production]
08:02 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply [production]
08:02 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply [production]
07:28 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply [production]
07:27 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply [production]
03:24 <larssandergreen> Updating civicrm from 7a979750 to 9cc43ebd [production]
03:08 <larssandergreen> Updating civicrm from 36b09796 to 7a979750 [production]
02:57 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Depooling db1175 (T410589)', diff saved to https://phabricator.wikimedia.org/P86417 and previous config saved to /var/cache/conftool/dbconfig/20251205-025711-ladsgroup.json [production]
02:57 <ladsgroup@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1175.eqiad.wmnet with reason: Maintenance [production]
02:56 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T410589)', diff saved to https://phabricator.wikimedia.org/P86416 and previous config saved to /var/cache/conftool/dbconfig/20251205-025647-ladsgroup.json [production]
02:41 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P86415 and previous config saved to /var/cache/conftool/dbconfig/20251205-024139-ladsgroup.json [production]
02:40 <ejegg> payments-wiki upgraded from 9ab44e85 to 5c381b45 [production]
02:26 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P86414 and previous config saved to /var/cache/conftool/dbconfig/20251205-022631-ladsgroup.json [production]
02:11 <ladsgroup@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1166 (T410589)', diff saved to https://phabricator.wikimedia.org/P86413 and previous config saved to /var/cache/conftool/dbconfig/20251205-021123-ladsgroup.json [production]
02:09 <wfan> donorwiki upgraded from 053b3f88 to 9ab44e85 [production]
02:07 <wfan> payments-wiki upgraded from d2799b95 to 9ab44e85 [production]
02:01 <rzl> rzl@apt1002:~$ sudo -i reprepro -C component/envoy-future include bullseye-wikimedia /home/rzl/envoyproxy_1.35.7-1_amd64.changes [production]
01:44 <wfan> SmashPig upgraded from a25fbb28 to 1442d0a0 [production]
01:41 <eileen> civicrm upgraded from d4bd9b1b to 36b09796 [production]
01:13 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 13m 06s) [production]
01:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
00:27 <Amir1> ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki huwikiquote --mark "Corrupted UTF-8 (T351953)" --revisions 3804,3808,3811,3813,3814,3818,3825 [production]
00:26 <Amir1> ladsgroup@deploy2002:~$ mwscript-k8s --follow -- findBadBlobs.php --wiki guwiktionary --mark "Corrupted UTF-8 (T351953)" --revisions 20576 [production]
2025-12-04 §
23:47 <tzatziki> removing 4 files for legal compliance [production]
23:34 <tzatziki> removing 2 files for legal compliance [production]
23:23 <tzatziki> removing 3 files for legal compliance [production]
23:16 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hadoop.reboot-workers (exit_code=0) for Hadoop test cluster [production]
23:16 <tzatziki> removing 5 files for legal compliance [production]
23:04 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy7002.magru.wmnet [production]
23:02 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy7001.magru.wmnet [production]
23:00 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy7002.magru.wmnet [production]
23:00 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy6002.drmrs.wmnet [production]
22:59 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy6001.drmrs.wmnet [production]
22:59 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy5002.eqsin.wmnet [production]
22:58 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy7001.magru.wmnet [production]
22:56 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy5001.eqsin.wmnet [production]
22:56 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy6002.drmrs.wmnet [production]
22:55 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy6001.drmrs.wmnet [production]
22:55 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy5002.eqsin.wmnet [production]
22:55 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3002.esams.wmnet [production]
22:55 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy4002.ulsfo.wmnet [production]
22:52 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy3001.esams.wmnet [production]
22:52 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host tcp-proxy5001.eqsin.wmnet [production]
22:51 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host tcp-proxy2002.codfw.wmnet [production]