|
2020-07-31
§
|
| 19:39 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 19:20 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2017.codfw.wmnet |
[production] |
| 18:57 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2016.codfw.wmnet |
[production] |
| 17:45 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 17:45 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:45 |
<mutante> |
rebooting / reinstalling OS on xhgui1001 |
[production] |
| 17:25 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 17:25 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:21 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 17:21 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:13 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 17:13 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:12 |
<dzahn@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 17:11 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:24 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:22 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:22 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:20 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:32 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:30 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:52 |
<elukey> |
update cr1/cr2-eqiad's analytics filters (ref: https://gerrit.wikimedia.org/r/c/operations/homer/public/+/617649/) |
[production] |
| 13:51 |
<moritzm> |
installing cups security updates (client-side tools/libs only) |
[production] |
| 13:20 |
<moritzm> |
installing openjpeg2 security updates |
[production] |
| 13:04 |
<kormat> |
proudly uploaded version 0.1 of python3-wmfmariadbpy + wmfmariadbpy |
[production] |
| 11:55 |
<moritzm> |
installing mercurial security updates |
[production] |
| 11:21 |
<jynus> |
restart dbstore1004 |
[production] |
| 11:19 |
<moritzm> |
installing ffmpeg security updates for jessie (standard version from security.debian.org, not the VP9-enabled component) |
[production] |
| 11:16 |
<moritzm> |
imported ffmpeg 3.2.15-0+deb9u1+wmf1 to component/vp9 for stretch-wikimedia T259336 |
[production] |
| 07:51 |
<moritzm> |
updating lilypond on mw* servers |
[production] |
| 07:50 |
<moritzm> |
uploaded lilypond 2.19.81+really-2.18.2-13~bpo9+1+wmf1 to stretch-wikimedia T256877 |
[production] |
| 07:07 |
<elukey> |
stop mysql replication on db1108; update port config for mysql instances and restart them; restart replication on instances |
[production] |
| 06:32 |
<elukey> |
roll restart of druid brokers on druid100[4-8] to pick up new changes |
[production] |
| 06:26 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 06:26 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 05:59 |
<moritzm> |
installing qemu updates on stretch |
[production] |
| 04:56 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 04:54 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 04:22 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 04:20 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 03:55 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 03:53 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 03:14 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 03:12 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 02:57 |
<andrew@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 02:55 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 00:47 |
<tstarling@deploy1001> |
Synchronized wmf-config/CommonSettings.php: disable lilypond execution again (duration: 01m 10s) |
[production] |
| 00:07 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.2/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 06s) |
[production] |
| 00:06 |
<catrope@deploy1001> |
Synchronized php-1.36.0-wmf.1/extensions/Echo/modules/mobile/notificationsFilterOverlay.js: T258954 (duration: 01m 10s) |
[production] |
| 00:00 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=wtp2015.codfw.wmnet |
[production] |