|
2026-03-14
§
|
| 02:41 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1052.eqiad.wmnet}' (T419948) |
[admin] |
| 02:41 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1053.eqiad.wmnet}' (T419948) |
[admin] |
| 02:13 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1053.eqiad.wmnet}' (T419948) |
[admin] |
| 02:13 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1054.eqiad.wmnet}' (T419948) |
[admin] |
| 02:08 |
<mwpresync@deploy2002> |
Finished scap build-images: Publishing wmf/next image (duration: 08m 00s) |
[production] |
| 02:00 |
<mwpresync@deploy2002> |
Started scap build-images: Publishing wmf/next image |
[production] |
| 01:47 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1054.eqiad.wmnet}' (T419948) |
[admin] |
| 01:47 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1055.eqiad.wmnet}' (T419948) |
[admin] |
| 01:29 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1055.eqiad.wmnet}' (T419948) |
[admin] |
| 01:29 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1056.eqiad.wmnet}' (T419948) |
[admin] |
|
2026-03-13
§
|
| 23:22 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1056.eqiad.wmnet}' (T419948) |
[admin] |
| 23:22 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1057.eqiad.wmnet}' (T419948) |
[admin] |
| 23:09 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1057.eqiad.wmnet}' (T419948) |
[admin] |
| 23:09 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1058.eqiad.wmnet}' (T419948) |
[admin] |
| 22:52 |
<taavi> |
taavi@deploy2002 ~ $ mwscript CentralAuth:attachAccount.php --wiki=metawiki --userlist backfiller.txt # unify unified Special:CentralAuth/MediaWikiAccountBackfiller on meta |
[production] |
| 22:44 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1058.eqiad.wmnet}' (T419948) |
[admin] |
| 22:44 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1059.eqiad.wmnet}' (T419948) |
[admin] |
| 22:25 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1059.eqiad.wmnet}' (T419948) |
[admin] |
| 22:25 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1060.eqiad.wmnet}' (T419948) |
[admin] |
| 22:19 |
<taavi> |
reboot bastion-eqiad1-5 T420044 |
[bastion] |
| 22:05 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1060.eqiad.wmnet}' (T419948) |
[admin] |
| 22:05 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1061.eqiad.wmnet}' (T419948) |
[admin] |
| 22:04 |
<taavi> |
reboot tools-bastion-15 T420044 |
[tools] |
| 21:40 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1061.eqiad.wmnet}' (T419948) |
[admin] |
| 21:40 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1062.eqiad.wmnet}' (T419948) |
[admin] |
| 21:21 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1062.eqiad.wmnet}' (T419948) |
[admin] |
| 21:21 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1063.eqiad.wmnet}' (T419948) |
[admin] |
| 21:03 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1063.eqiad.wmnet}' (T419948) |
[admin] |
| 21:03 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1064.eqiad.wmnet}' (T419948) |
[admin] |
| 20:47 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1064.eqiad.wmnet}' (T419948) |
[admin] |
| 20:47 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1065.eqiad.wmnet}' (T419948) |
[admin] |
| 20:37 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.vps.instance.stop_start (exit_code=99) vm zuul-k8s-v128-qnv6fefra4wd-node-2 (cluster eqiad1) |
[zuul] |
| 20:37 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.vps.instance.stop_start vm zuul-k8s-v128-qnv6fefra4wd-node-2 (cluster eqiad1) |
[zuul] |
| 20:33 |
<wmbot~jeanfred@tools-bastion-15> |
Deploy a39f1d9 (Add proper handling for transient Wikidata server errors) for T415439 |
[tools.integraality] |
| 20:31 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1065.eqiad.wmnet}' (T419948) |
[admin] |
| 20:31 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1066.eqiad.wmnet}' (T419948) |
[admin] |
| 20:27 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1) |
[paws] |
| 20:26 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.vps.instance.stop_start vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1) |
[paws] |
| 20:19 |
<wmbot~jeanfred@tools-bastion-15> |
Deploy 0c418a5 (Fix tests hitting live Wikidata API (and potential rate-limits)) for T420054 |
[tools.integraality] |
| 20:13 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1066.eqiad.wmnet}' (T419948) |
[admin] |
| 20:13 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1067.eqiad.wmnet}' (T419948) |
[admin] |
| 20:08 |
<andrew@cloudcumin1001> |
END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm phi-syslog-01 (cluster eqiad1) |
[o11y] |
| 20:08 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.vps.instance.stop_start vm phi-syslog-01 (cluster eqiad1) |
[o11y] |
| 20:07 |
<andrew@cumin2002> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudservices2004-dev.codfw.wmnet |
[production] |
| 20:06 |
<andrewbogott> |
restarting phi-syslog-01 to fix incorrect MTU |
[o11y] |
| 20:05 |
<andrewbogott> |
restarting k3s-envDB to fix incorrect MTU |
[catalyst-dev] |
| 20:01 |
<andrew@cloudcumin1001> |
END (FAIL) - Cookbook wmcs.vps.instance.stop_start (exit_code=99) vm zuul-k8s-v128-qnv6fefra4wd-node-9 (cluster eqiad1) |
[zuul] |
| 20:01 |
<andrew@cloudcumin1001> |
START - Cookbook wmcs.vps.instance.stop_start vm zuul-k8s-v128-qnv6fefra4wd-node-9 (cluster eqiad1) |
[zuul] |
| 20:01 |
<andrewbogott> |
stop/starting several k8s nodes to fix incorrect MTU |
[zuul] |
| 20:01 |
<andrew@cumin2002> |
START - Cookbook sre.hosts.reboot-single for host cloudservices2004-dev.codfw.wmnet |
[production] |