|
2023-05-15
ยง
|
| 15:00 |
<aokoth@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on vrts2001.codfw.wmnet with reason: Setup Incomplete |
[production] |
| 15:00 |
<aokoth@cumin1001> |
START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on vrts2001.codfw.wmnet with reason: Setup Incomplete |
[production] |
| 14:58 |
<hauskater> |
Dropped akwiki and nawiki from CVNBot10 as closed wikis. On-wiki lists require an update. |
[cvn] |
| 14:28 |
<wm-bot2> |
Drained cloudvirt1034.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 14:28 |
<wm-bot2> |
Set cloudvirt cloudvirt1034.eqiad.wmnet maintenance (downtime id: 96ce2ed0-3aff-4d04-be0b-e16513070617, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 14:27 |
<wm-bot2> |
Draining cloudvirt1034.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 14:24 |
<bking@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on wdqs2021.codfw.wmnet with reason: testing transferpy cookbook |
[production] |
| 14:24 |
<bking@cumin1001> |
START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on wdqs2021.codfw.wmnet with reason: testing transferpy cookbook |
[production] |
| 14:23 |
<wm-bot2> |
Drained cloudvirt1027.eqiad.wmnet (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 14:21 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1001.eqiad.wmnet with OS bullseye |
[production] |
| 14:20 |
<klausman@deploy1002> |
helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. |
[production] |
| 14:20 |
<klausman@deploy1002> |
helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. |
[production] |
| 14:17 |
<wm-bot2> |
Set cloudvirt cloudvirt1027.eqiad.wmnet maintenance (downtime id: 110176f8-04d5-4110-bb7d-1ab272bd8be2, use this to unset) (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 14:17 |
<klausman@deploy1002> |
helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. |
[production] |
| 14:16 |
<wm-bot2> |
Draining cloudvirt1027.eqiad.wmnet (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 14:16 |
<klausman@deploy1002> |
helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. |
[production] |
| 14:13 |
<wm-bot2> |
Set cloudvirt cloudvirt1033.eqiad.wmnet maintenance (downtime id: c6e92e13-49f4-4db3-8a13-8692ccfd3bc9, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 14:12 |
<wm-bot2> |
Draining cloudvirt1033.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 14:12 |
<wm-bot2> |
Drained cloudvirt1035.eqiad.wmnet (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 14:11 |
<wm-bot2> |
Set cloudvirt cloudvirt1033.eqiad.wmnet maintenance (downtime id: fa730dec-848f-45fb-9eda-e74bd874c5c9, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 14:10 |
<wm-bot2> |
Draining cloudvirt1033.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 14:06 |
<wm-bot2> |
Restarting openstack services on cloudbackup2001: ['cinder-backup'] - cookbook ran by andrew@bullseye |
[admin] |
| 14:06 |
<wm-bot2> |
Restarting openstack services on cloudcontrol1006: ['cinder-volume', 'cinder-scheduler'] - cookbook ran by andrew@bullseye |
[admin] |
| 14:06 |
<wm-bot2> |
Restarting openstack services on cloudcontrol1007: ['cinder-volume', 'cinder-scheduler'] - cookbook ran by andrew@bullseye |
[admin] |
| 14:06 |
<wm-bot2> |
Restarting openstack services on cloudbackup2002: ['cinder-backup'] - cookbook ran by andrew@bullseye |
[admin] |
| 14:06 |
<wm-bot2> |
Restarting openstack services on cloudcontrol1005: ['cinder-volume', 'cinder-scheduler'] - cookbook ran by andrew@bullseye |
[admin] |
| 14:03 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1001.eqiad.wmnet with reason: host reimage |
[production] |
| 14:01 |
<wm-bot2> |
Set cloudvirt cloudvirt1033.eqiad.wmnet maintenance (downtime id: eb1cfac0-d481-4baa-b9cd-15e5fbcef495, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 14:00 |
<wm-bot2> |
Draining cloudvirt1033.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 14:00 |
<volans@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1001.eqiad.wmnet with reason: host reimage |
[production] |
| 13:58 |
<wm-bot2> |
Set cloudvirt cloudvirt1034.eqiad.wmnet maintenance (downtime id: 3e6c3ff3-7d55-4777-9032-b867a257eced, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 13:57 |
<wm-bot2> |
Draining cloudvirt1034.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 13:56 |
<volans> |
re-enabled puppet on the install hosts to deploy changes for T336485 |
[production] |
| 13:53 |
<wm-bot2> |
Set cloudvirt cloudvirt1033.eqiad.wmnet maintenance (downtime id: 0693664a-df78-417e-ba34-590e5a0a9981, use this to unset) - cookbook ran by andrew@bullseye |
[admin] |
| 13:52 |
<wm-bot2> |
Draining cloudvirt1033.eqiad.wmnet - cookbook ran by andrew@bullseye |
[admin] |
| 13:49 |
<wm-bot2> |
Set cloudvirt cloudvirt1035.eqiad.wmnet maintenance (downtime id: e6929ab8-4bc3-4186-817b-9b53dbd597c6, use this to unset) (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 13:48 |
<wm-bot2> |
Draining cloudvirt1035.eqiad.wmnet (T316544) - cookbook ran by dcaro@vulcanus |
[admin] |
| 13:45 |
<volans@cumin1001> |
START - Cookbook sre.hosts.reimage for host sretest1001.eqiad.wmnet with OS bullseye |
[production] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirtlocal1003: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirtlocal1002: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirtlocal1001: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirt1054: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirt1055: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:40 |
<wm-bot2> |
Restarting openstack services on cloudvirt1060: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1058: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1059: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1061: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1057: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1056: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |
| 13:39 |
<wm-bot2> |
Restarting openstack services on cloudvirt1051: ['nova-compute'] - cookbook ran by andrew@bullseye |
[admin] |