|
2020-05-12
§
|
| 12:08 |
<gehel> |
restart blazegraph + updater on wdqs2002 - JVM upgrade |
[production] |
| 11:56 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 11:20 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:17 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:55 |
<vgutierrez> |
upgrade trafficserver to version 8.0.7-1wm5 on cp5011 - T249335 |
[production] |
| 10:54 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) |
[production] |
| 10:53 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 10:53 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) |
[production] |
| 10:52 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 10:43 |
<kormat> |
reimaging pc2010 to buster T252182 |
[production] |
| 10:30 |
<vgutierrez> |
upgrade trafficserver to version 8.0.7-1wm5 on cp4032 - T249335 |
[production] |
| 10:30 |
<ema> |
rolling thumbor upgrade to 2.6-1+deb10u1 T226707 |
[production] |
| 10:19 |
<ema> |
repool thumbor2001 with upgraded python-thumbor-wikimedia |
[production] |
| 10:13 |
<ema> |
thumbor2001: upgrade python-thumbor-wikimedia to 2.6-1+deb10u1 |
[production] |
| 10:04 |
<godog> |
update compiler facts |
[production] |
| 09:35 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:35 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:34 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 09:34 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 09:31 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 09:31 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 09:31 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=99) |
[production] |
| 09:31 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 09:29 |
<filippo@cumin1001> |
conftool action : set/pooled=yes:weight=100; selector: cluster=thanos |
[production] |
| 09:07 |
<moritzm> |
rebooting contint2001 for kernel update |
[production] |
| 09:07 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 09:06 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:46 |
<godog> |
reboot thanos hosts for kernel upgrade |
[production] |
| 07:41 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:41 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:29 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:29 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:12 |
<moritzm> |
rebooting the IDP hosts, SSO sessions will need to be renewed |
[production] |
| 07:04 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 07:04 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 06:56 |
<vgutierrez> |
upload trafficserver 8.0.7-1wm4 to apt.wm.o (buster) - T242767 T249335 |
[production] |
| 05:29 |
<marostegui> |
Restart docker-report-releng on deneb |
[production] |
| 05:03 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Set s4 as read-only=off for maintenance T251502', diff saved to https://phabricator.wikimedia.org/P11180 and previous config saved to /var/cache/conftool/dbconfig/20200512-050339-marostegui.json |
[production] |
| 05:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Set s4 as read-only for maintenance T251502', diff saved to https://phabricator.wikimedia.org/P11179 and previous config saved to /var/cache/conftool/dbconfig/20200512-050054-marostegui.json |
[production] |
| 04:46 |
<marostegui> |
Stop mysql on labsdb1011 to transfer its content - T249188 |
[production] |
| 02:14 |
<pt1979@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 02:12 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 01:45 |
<pt1979@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 01:43 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 01:16 |
<pt1979@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 01:14 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 00:37 |
<pt1979@cumin2001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 00:34 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |