|
2020-08-17
§
|
| 09:58 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:58 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:56 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:55 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) |
[production] |
| 09:52 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:48 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:45 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) |
[production] |
| 09:42 |
<jynus> |
updating compiler facts for cloud puppet compiler project to include new host dbprov2003 |
[production] |
| 09:39 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:38 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:38 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:36 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:36 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:29 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:28 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:27 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:23 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) |
[production] |
| 09:22 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:21 |
<jayme@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) |
[production] |
| 09:18 |
<_joe_> |
running a full apt-get upgrade on mw1379-1380 |
[production] |
| 09:18 |
<_joe_> |
re-upgrading imagemagick on mw1378 |
[production] |
| 09:16 |
<_joe_> |
upgrading packages on mw1377 |
[production] |
| 09:14 |
<jayme@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 09:06 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:06 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:05 |
<jayme@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 08:25 |
<jayme> |
forcing a puppet run on all mw-api servers in eqiad - T260329 |
[production] |
| 07:52 |
<_joe_> |
repooling mw1382 |
[production] |
| 07:37 |
<_joe_> |
running the same test on mw1382 T260329 |
[production] |
| 07:34 |
<_joe_> |
repooling mw1381 |
[production] |
| 07:15 |
<_joe_> |
running the same test on mw1381 T260329 |
[production] |
| 07:15 |
<_joe_> |
repooled mw1281 |
[production] |
| 06:26 |
<_joe_> |
stop testing on mw1281, T260329 |
[production] |
| 05:45 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 05:43 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:28 |
<marostegui> |
Stop mysql on db1099:3311, db1099:3318 for reimage |
[production] |
| 05:28 |
<_joe_> |
depooling mw1281 for testing for T260329 |
[production] |
| 05:25 |
<marostegui> |
Deploy schema change on db1139:3311 |
[production] |
| 05:21 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1099:3311, db1099:3318 for reimage and MCR change', diff saved to https://phabricator.wikimedia.org/P12263 and previous config saved to /var/cache/conftool/dbconfig/20200817-052147-marostegui.json |
[production] |