1451-1500 of 10000 results (29ms)
2026-03-16 ยง
08:22 <wmftkbot> Test Kitchen edge-unique experiments (poll 260175) - adds: synth-aa-test-traffic-impact-3, synth-aa-test-traffic-impact-2; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
08:22 <wmftkbot> Test Kitchen edge-unique experiments (poll 260174) - adds: synth-aa-test-traffic-impact-1; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
08:22 <taavi@cumin1003> conftool action : set/pooled=no; selector: name=clouddb1013.eqiad.wmnet,service=s3 [production]
08:18 <kgraessle@deploy2002> Finished scap sync-world: Backport for [[gerrit:1251276|Fix broken survey links on PersonalDashboard (T419950)]] (duration: 32m 09s) [production]
08:17 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti7004.magru.wmnet [production]
08:10 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7004.magru.wmnet [production]
08:06 <jelto@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gitlab1004.wikimedia.org [production]
08:05 <kgraessle@deploy2002> kgraessle: Continuing with sync [production]
08:04 <kgraessle@deploy2002> kgraessle: Backport for [[gerrit:1251276|Fix broken survey links on PersonalDashboard (T419950)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:59 <jelto@cumin1003> START - Cookbook sre.hosts.reboot-single for host gitlab1004.wikimedia.org [production]
07:52 <moritzm> installing Linux 5.10.251 on Bullseye hosts [production]
07:45 <kgraessle@deploy2002> Started scap sync-world: Backport for [[gerrit:1251276|Fix broken survey links on PersonalDashboard (T419950)]] [production]
07:37 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host stewards1001.eqiad.wmnet [production]
07:33 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host stewards1001.eqiad.wmnet [production]
07:33 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host vrts1003.eqiad.wmnet [production]
07:26 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host vrts1003.eqiad.wmnet [production]
07:25 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host aphlict1002.eqiad.wmnet [production]
07:21 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host aphlict1002.eqiad.wmnet [production]
07:10 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host doc2003.codfw.wmnet [production]
07:06 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host doc2003.codfw.wmnet [production]
07:02 <arnaudb@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lists1004.wikimedia.org [production]
06:55 <arnaudb@cumin1003> START - Cookbook sre.hosts.reboot-single for host lists1004.wikimedia.org [production]
05:36 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1040.eqiad.wmnet}' (T419948) [admin]
05:25 <aikochou@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revise-tone-task-generator' for release 'main' . [production]
05:14 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1040.eqiad.wmnet}' (T419948) [admin]
05:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1041.eqiad.wmnet}' (T419948) [admin]
04:52 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1041.eqiad.wmnet}' (T419948) [admin]
04:52 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1042.eqiad.wmnet}' (T419948) [admin]
04:31 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1042.eqiad.wmnet}' (T419948) [admin]
04:31 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1043.eqiad.wmnet}' (T419948) [admin]
04:09 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1043.eqiad.wmnet}' (T419948) [admin]
04:09 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1044.eqiad.wmnet}' (T419948) [admin]
03:42 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1044.eqiad.wmnet}' (T419948) [admin]
03:42 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1045.eqiad.wmnet}' (T419948) [admin]
03:17 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1045.eqiad.wmnet}' (T419948) [admin]
03:16 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1046.eqiad.wmnet}' (T419948) [admin]
02:56 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1046.eqiad.wmnet}' (T419948) [admin]
02:55 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1047.eqiad.wmnet}' (T419948) [admin]
02:30 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1047.eqiad.wmnet}' (T419948) [admin]
02:30 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1048.eqiad.wmnet}' (T419948) [admin]
02:08 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 07m 52s) [production]
02:06 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1048.eqiad.wmnet}' (T419948) [admin]
02:06 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' (T419948) [admin]
02:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
01:54 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' (T419948) [admin]
01:54 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for service: project,nova [admin]
01:47 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,nova [admin]
01:46 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=99) on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' (T419948) [admin]
01:45 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1049.eqiad.wmnet}' (T419948) [admin]
01:44 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=99) on hosts matched by 'D{cloudvirt1058.eqiad.wmnet}' (T419948) [admin]