|
2022-07-19
§
|
| 02:11 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 02:06 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 02:05 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] START helmfile.d/services/mwdebug: apply |
[production] |
| 02:05 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] DONE helmfile.d/services/mwdebug: apply |
[production] |
| 02:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] START helmfile.d/services/mwdebug: apply |
[production] |
| 02:03 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: 6a64d619-c484-411f-ad9d-89d43b063737, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 02:02 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 02:02 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: 301309a2-a8b5-4698-98d6-bb4aa0a75e45, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1025.eqiad.wmnet' maintenance (downtime id: b2f8c6a2-7224-4fb1-8e12-dff6dda02380, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Draining 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:46 |
<wm-bot2> |
Safe rebooting 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:40 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:40 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:39 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:39 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:38 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: c0f62e0e-7865-4e77-a238-d707ceed53a8, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:38 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:38 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:36 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1025.eqiad.wmnet' maintenance (downtime id: 96a368d5-232f-4187-b0bb-5923a50fff71, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:36 |
<wm-bot2> |
Draining 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:36 |
<wm-bot2> |
Safe rebooting 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:35 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: 31b6bfcb-81cb-4d89-b977-190899ea2e64, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:35 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:35 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:28 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: 50f763d4-36ea-4241-8e71-cc6aa20ccc9e, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:28 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1025.eqiad.wmnet' maintenance (downtime id: cd3d17af-ee15-4a9f-8750-66b97a46ea12, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:27 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:27 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:27 |
<wm-bot2> |
Draining 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:27 |
<wm-bot2> |
Safe rebooting 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:22 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:22 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:22 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1025.eqiad.wmnet' maintenance (downtime id: 9b075166-d424-42c0-8e06-f74a47abb798, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 00:21 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:21 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:21 |
<wm-bot2> |
Draining 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:21 |
<wm-bot2> |
Safe rebooting 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 00:03 |
<bd808> |
Manually restarted to recover from netsplit |
[tools.stashbot] |
|
2022-07-18
§
|
| 23:58 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1050.eqiad.wmnet |
[production] |
| 23:46 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cloudvirt1050.eqiad.wmnet |
[production] |
| 23:45 |
<AntiComposite> |
SULWatcher/manage.sh restart |
[tools.stewardbots] |
| 23:19 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host cloudvirt1049.eqiad.wmnet |
[production] |
| 23:11 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1024.eqiad.wmnet' maintenance (downtime id: e0aab64f-d911-4d7e-9a97-c59d9868ceea, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 23:11 |
<wm-bot2> |
Set cloudvirt 'cloudvirt1025.eqiad.wmnet' maintenance (downtime id: 447d9c7a-a00e-41db-93ed-6d2bfc66e5df, use this to unset). - cookbook ran by andrew@buster |
[admin] |
| 23:11 |
<wm-bot2> |
Draining 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 23:11 |
<wm-bot2> |
Safe rebooting 'cloudvirt1024.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |
| 23:11 |
<wm-bot2> |
Draining 'cloudvirt1025.eqiad.wmnet'. - cookbook ran by andrew@buster |
[admin] |