6151-6200 of 10000 results (34ms)
2025-05-08 §
14:03 <eevans@cumin1002> START - Cookbook sre.dns.netbox [production]
13:52 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [toolsbeta]
13:52 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
13:52 <pt1979@cumin1002> START - Cookbook sre.hosts.reimage for host db1246.eqiad.wmnet with OS bookworm [production]
13:51 <eevans@cumin1002> START - Cookbook sre.hosts.decommission for hosts restbase[1028-1030].eqiad.wmnet [production]
13:42 <volans> forced removal of db1246 from puppetdb to unblock reimage (was failing due to a puppet change in the meanwhile) [production]
13:40 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ganeti2047.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:35 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host ganeti2047.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
13:34 <tchanders@deploy1003> Finished scap sync-world: Backport for [[gerrit:1142858|temp accounts: Remove AutopromoteOnce configuration (T393358)]] (duration: 16m 30s) [production]
13:27 <tchanders@deploy1003> tchanders, kharlan: Continuing with sync [production]
13:26 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [tools]
13:24 <tchanders@deploy1003> tchanders, kharlan: Backport for [[gerrit:1142858|temp accounts: Remove AutopromoteOnce configuration (T393358)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
13:20 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component envvars-admission [toolsbeta]
13:20 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission [toolsbeta]
13:17 <tchanders@deploy1003> Started scap sync-world: Backport for [[gerrit:1142858|temp accounts: Remove AutopromoteOnce configuration (T393358)]] [production]
13:13 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [tools]
13:07 <wmbot~lucaswerkmeister@tools-bastion-13> deployed a330358f39 (l10n updates: hu, ka); also includes 8865bb0c67 (l10n updates: kaa) – apparently I forgot to `git rebase` after `git fetch` last time 🤦 [tools.wd-image-positions]
13:05 <wmbot~lucaswerkmeister@tools-bastion-13> deployed d1e60efda3 (l10n updates: nl) [tools.ranker]
13:05 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway [toolsbeta]
13:03 <moritzm> installing jetty9 security updates [production]
12:53 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component api-gateway [toolsbeta]
12:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon1003.wikimedia.org [production]
12:32 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netmon1003.wikimedia.org [production]
12:31 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon2002.wikimedia.org [production]
12:25 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host netmon2002.wikimedia.org [production]
12:18 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
12:06 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
11:57 <moritzm> import transferpy 1.1+deb12u1 to bookworm-wikimedia T389380 [production]
11:44 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ping2004.codfw.wmnet [production]
11:44 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
11:43 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
11:40 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ping2004.codfw.wmnet [production]
11:32 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ping1004.eqiad.wmnet [production]
11:32 <jmm@cumin2002> END (PASS) - Cookbook sre.netbox.restart-reboot (exit_code=0) rolling reboot on A:netbox [production]
11:31 <taavi> backfilling AAAA records for web proxies using wmcloud.org T379175 [cloudinfra]
11:28 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ping1004.eqiad.wmnet [production]
11:19 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) netbox.discovery.wmnet. on all recursors [production]
11:19 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache netbox.discovery.wmnet. on all recursors [production]
11:15 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) netbox.discovery.wmnet. on all recursors [production]
11:15 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache netbox.discovery.wmnet. on all recursors [production]
11:15 <jmm@cumin2002> START - Cookbook sre.netbox.restart-reboot rolling reboot on A:netbox [production]
10:58 <James_F> Zuul: Support capital first letter of e-mail for Aeywoo in allow list [releng]
10:54 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
10:53 <taavi> backfilling AAAA records for web proxies using wmflabs.org T379175 [wmflabsdotorg]
10:45 <zabe> zabe@deploy1003:~$ mwscript-k8s --attach -- extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki "Wikimedia Foundation Board of Trustees" "Wikimedia Foundation/Board of Trustees" "Zabe" --reason "per request [[:phab:T393619|T393619]]" [production]
10:45 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
10:43 <dcaro@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api [toolsbeta]
10:39 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
10:31 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
10:30 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]