|
2019-06-21
§
|
| 13:48 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:48 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 13:43 |
<akosiaris@deploy1001> |
scap-helm mathoid finished |
[production] |
| 13:43 |
<akosiaris@deploy1001> |
scap-helm mathoid cluster staging completed |
[production] |
| 13:43 |
<akosiaris@deploy1001> |
scap-helm mathoid upgrade --recreate-pods -f mathoid-staging-values.yaml staging stable/mathoid [namespace: mathoid, clusters: staging] |
[production] |
| 13:33 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 13:26 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 13:16 |
<moritzm> |
rebooting kafkamon instances to pick up MDS mitigations/new kernel |
[production] |
| 13:16 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:16 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:11 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:11 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:58 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 12:51 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 12:36 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 12:30 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 10:15 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 10:13 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 10:09 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 10:06 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 09:51 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 09:45 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 09:43 |
<moritzm> |
rebooting cp1008 |
[production] |
| 09:42 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 09:35 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 09:30 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 09:23 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 09:15 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 09:09 |
<jiji@deploy1001> |
Synchronized wmf-config/ProductionServices.php: Remove kafka1018 from ProductionServices - T224538 (duration: 00m 56s) |
[production] |
| 09:08 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 09:08 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 09:01 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 08:48 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 08:46 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 08:42 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 08:40 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 07:39 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=codfw,cluster=kubernetes,service=eventgate-analytics,name=kubernetes2001.codfw.wmnet |
[production] |
| 07:38 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=codfw,cluster=kubernetes,service=eventgate-main,name=kubernetes2001.codfw.wmnet |
[production] |
| 07:24 |
<moritzm> |
installing python-thumbor-wikimedia, python-opencv on stat1006 |
[production] |
| 06:54 |
<moritzm> |
installed radeontop on stat1005 to diagnose GPU usage (T220811) |
[production] |
| 06:44 |
<moritzm> |
installed python-opencv on stat1005 (T220811) |
[production] |
| 05:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Pool db2051 into s2 to replace db2035 as a master (duration: 01m 00s) |
[production] |
| 00:45 |
<RoanKattouw> |
Running FlowReserializeRevisionContent.php on testwiki |
[production] |