1-50 of 10000 results (16ms)
2025-09-30 ยง
23:55 <krinkle@deploy2002> krinkle: Continuing with sync [production]
23:54 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host dbprov1007.eqiad.wmnet with OS bookworm [production]
23:53 <krinkle@deploy2002> krinkle: Backport for [[gerrit:1192278|Disable wmgUseMdotRouting on Wikidata (T403510)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:46 <krinkle@deploy2002> Started scap sync-world: Backport for [[gerrit:1192278|Disable wmgUseMdotRouting on Wikidata (T403510)]] [production]
23:36 <krinkle@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192277|Disable wmgUseMdotRouting on Wiktionary (T403510)]] (duration: 12m 27s) [production]
23:31 <krinkle@deploy2002> krinkle: Continuing with sync [production]
23:28 <krinkle@deploy2002> krinkle: Backport for [[gerrit:1192277|Disable wmgUseMdotRouting on Wiktionary (T403510)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:24 <krinkle@deploy2002> Started scap sync-world: Backport for [[gerrit:1192277|Disable wmgUseMdotRouting on Wiktionary (T403510)]] [production]
23:20 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1076.eqiad.wmnet}' [admin]
23:17 <krinkle@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192276|Disable wmgUseMdotRouting on Wikisource (T403510)]] (duration: 14m 01s) [production]
23:14 <jclark@cumin1002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host dbprov1007.eqiad.wmnet with OS bookworm [production]
23:12 <krinkle@deploy2002> krinkle: Continuing with sync [production]
23:10 <krinkle@deploy2002> krinkle: Backport for [[gerrit:1192276|Disable wmgUseMdotRouting on Wikisource (T403510)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
23:05 <brennen> jjb-update wikidata-query-flink-swift-plugin-maven-release wikidata-query-rdf-maven-release wikimedia-event-utilities-maven-release wmf-jvm-utils-maven-release (T406072) [releng]
23:03 <krinkle@deploy2002> Started scap sync-world: Backport for [[gerrit:1192276|Disable wmgUseMdotRouting on Wikisource (T403510)]] [production]
23:01 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1076.eqiad.wmnet}' [admin]
23:01 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1075.eqiad.wmnet}' [admin]
22:43 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1075.eqiad.wmnet}' [admin]
22:43 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1074.eqiad.wmnet}' [admin]
22:33 <brennen> jjb-update 'analytics-refinery-maven-release' (T406072) [releng]
22:29 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt2005-dev.codfw.wmnet}' [admin]
22:29 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt2006-dev.codfw.wmnet}' [admin]
22:26 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1074.eqiad.wmnet}' [admin]
22:26 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1073.eqiad.wmnet}' [admin]
22:22 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1073.eqiad.wmnet}' [admin]
22:22 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1072.eqiad.wmnet}' [admin]
22:20 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt2006-dev.codfw.wmnet}' [admin]
22:20 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=99) on hosts matched by 'D{cloudvirt2006-dev.eqiad.wmnet}' [admin]
22:19 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt2006-dev.eqiad.wmnet}' [admin]
22:04 <jclark@cumin1002> START - Cookbook sre.hosts.reimage for host dbprov1007.eqiad.wmnet with OS bookworm [production]
22:03 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1072.eqiad.wmnet}' [admin]
22:02 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1071.eqiad.wmnet}' [admin]
21:59 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1071.eqiad.wmnet}' [admin]
21:59 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1070.eqiad.wmnet}' [admin]
21:56 <urbanecm@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
21:51 <urbanecm@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
21:51 <urbanecm@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-experimental: apply [production]
21:51 <urbanecm@deploy2002> helmfile [codfw] START helmfile.d/services/mw-experimental: apply [production]
21:40 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1070.eqiad.wmnet}' [admin]
21:40 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1069.eqiad.wmnet}' [admin]
21:20 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1069.eqiad.wmnet}' [admin]
21:20 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1068.eqiad.wmnet}' [admin]
21:04 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1068.eqiad.wmnet}' [admin]
21:04 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1067.eqiad.wmnet}' [admin]
20:49 <tgr_> UTC late deploys done [production]
20:49 <ejegg> fundraising civicrm upgraded from 3ca0872a to 7c31a25c [production]
20:47 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1192613|Enable JWT session cookies on group0 (T399631)]] (duration: 15m 27s) [production]
20:44 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1067.eqiad.wmnet}' [admin]
20:43 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1066.eqiad.wmnet}' [admin]
20:42 <tgr@deploy2002> tgr: Continuing with sync [production]