|
2019-05-30
ยง
|
| 12:25 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:25 |
<arturo> |
cordon/drain tools-worker-1002 because T224651 and T224651 |
[tools] |
| 12:23 |
<arturo> |
cordon/drain tools-worker-1001 because T224651 and T224651 |
[tools] |
| 12:22 |
<arturo> |
cordon/drain tools-worker-1029 because T224651 and T224651 |
[tools] |
| 12:21 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:21 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:20 |
<arturo> |
cordon/drain tools-worker-1003 because T224651 and T224651 |
[tools] |
| 12:15 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:15 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:08 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:08 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:08 |
<wm-bot> |
<jeanfred> Nuked the virtualenv and reinstalled all deps from scratch, in desperation for T224651 |
[tools.integraality] |
| 12:03 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:02 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:59 |
<arturo> |
T224558 repool tools-worker-1003 (using sssd/sudo now!) |
[tools] |
| 11:57 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:57 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:52 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:52 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:44 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:44 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:39 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:39 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:36 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:35 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:34 |
<akosiaris> |
reboot ganeti2003 for kernel upgrades |
[production] |
| 11:28 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:28 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:24 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:24 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:23 |
<arturo> |
T224558 depool tools-worker-1003 |
[tools] |
| 11:20 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:20 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:14 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:14 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:14 |
<_joe_> |
freed opcache on mw1281 |
[production] |
| 11:11 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:11 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:07 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:07 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:05 |
<Urbanecm> |
EU SWAT finished |
[production] |
| 11:04 |
<urbanecm@deploy1001> |
Synchronized wmf-config/abusefilter.php: [[:gerrit:Enable abusefilter blocking ability in plwiki]] (T224617) (duration: 00m 58s) |
[production] |
| 11:00 |
<jijiki> |
Disable puppet on mw* servers to merge 507939 - T219150 |
[production] |
| 10:59 |
<wm-bot> |
<jeanfred> Service stop, mv logs, service start for T224651 |
[tools.integraality] |
| 10:48 |
<arturo> |
T224558 drop/build a VM for tools-worker-1002. It didn't like the sssd/sudo change :-( |
[tools] |
| 10:42 |
<jynus> |
upgrade and restart db1117 (temporary proxy fail for passive host, reduced redundancy for m*) |
[production] |
| 10:39 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:39 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:36 |
<jbond@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:36 |
<jbond@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |