|
2019-06-19
ยง
|
| 16:50 |
<XioNoX> |
rollback redirect ns0 to authdns2001 |
[production] |
| 16:45 |
<moritzm> |
rebooting authdns1001 for kernel security update |
[production] |
| 16:42 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:42 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:39 |
<XioNoX> |
redirect ns0 to authdns2001 |
[production] |
| 16:37 |
<XioNoX> |
rollback redirect ns1 to authdns1001 |
[production] |
| 16:34 |
<moritzm> |
rebooting authdns2001 for kernel security update |
[production] |
| 16:28 |
<XioNoX> |
redirect ns1 to authdns1001 |
[production] |
| 16:26 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:26 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:23 |
<onimisionipe> |
pooling elastic1029 - T214283 |
[production] |
| 16:01 |
<ema> |
cache nodes: stop rolling reboots for today, 47/80 done T224694 T225998 |
[production] |
| 15:43 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: group0 back to .8 T226109 |
[production] |
| 15:43 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 15:40 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 15:37 |
<onimisionipe> |
pooled maps1002 - postgres init is complete and successfully joined to its cluster - T224395 |
[production] |
| 15:36 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 15:33 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 15:24 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:24 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:21 |
<moritzm> |
rolling reboot of proton* for kernel security update |
[production] |
| 15:18 |
<moritzm> |
rebooting boron for kernel security update |
[production] |
| 15:18 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:18 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:16 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 15:13 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 15:08 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 15:06 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 14:57 |
<XioNoX> |
update syslog target on frack network devices (T224128) |
[production] |
| 14:57 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:57 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:55 |
<jmm@cumin2001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 14:55 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:55 |
<XioNoX> |
jnt push to knams, remove old protect-old-lvs-servers term + update syslog target (T224128) + replace /28 with /29 (T211254) |
[production] |
| 14:54 |
<moritzm> |
rolling reboot of URL downloaders for kernel security update |
[production] |
| 14:48 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 14:48 |
<XioNoX> |
jnt push to eqiad, remove old protect-old-lvs-servers term + update syslog target T224128 |
[production] |
| 14:48 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 14:46 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: group1 back to .8 T226109 |
[production] |
| 14:40 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 14:40 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 14:20 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 14:20 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |
| 14:13 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 14:11 |
<ema@cumin1001> |
START - Cookbook sre.hosts.upgrade-and-reboot |
[production] |
| 14:06 |
<moritzm> |
rolling reboot of mwdebug servers for kernel security update |
[production] |
| 14:06 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:06 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 13:56 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Disabling Avro ApiAction Monolog channel - T222267 (duration: 00m 57s) |
[production] |
| 13:53 |
<ema@cumin1001> |
END (PASS) - Cookbook sre.hosts.upgrade-and-reboot (exit_code=0) |
[production] |