|
2021-01-15
ยง
|
| 15:17 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica1002.wikimedia.org |
[production] |
| 15:14 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-replica1002.wikimedia.org |
[production] |
| 15:11 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica1001.wikimedia.org |
[production] |
| 15:07 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-replica1001.wikimedia.org |
[production] |
| 15:05 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host moscovium.eqiad.wmnet |
[production] |
| 15:01 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host moscovium.eqiad.wmnet |
[production] |
| 14:42 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica2003.wikimedia.org |
[production] |
| 14:39 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-replica2003.wikimedia.org |
[production] |
| 14:29 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica2004.wikimedia.org |
[production] |
| 14:25 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single for host ldap-replica2004.wikimedia.org |
[production] |
| 11:30 |
<jynus> |
rolling restart of eqiad source backup dbs |
[production] |
| 11:19 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1002.eqiad.wmnet |
[production] |
| 11:15 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-conf1002.eqiad.wmnet |
[production] |
| 11:11 |
<XioNoX> |
update cloud-in4 firewall rules |
[production] |
| 11:06 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2036.codfw.wmnet |
[production] |
| 10:59 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc2036.codfw.wmnet |
[production] |
| 10:58 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1003.eqiad.wmnet |
[production] |
| 10:56 |
<jiji@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host mc2036.codfw.wmnet |
[production] |
| 10:55 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host mc2036.codfw.wmnet |
[production] |
| 10:53 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-conf1003.eqiad.wmnet |
[production] |
| 10:53 |
<vgutierrez> |
re-enable puppet on acme-chief clients |
[production] |
| 10:53 |
<jynus> |
rolling restart of dbprov2* hosts |
[production] |
| 10:52 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief1001.eqiad.wmnet |
[production] |
| 10:52 |
<_joe_> |
rebuilding the docker images coredns,nutcracker,prometheus-statsd-exporter,service-checker,wmfdebug to use wikimedia-buster as a base |
[production] |
| 10:51 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1001.eqiad.wmnet |
[production] |
| 10:48 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief1001.eqiad.wmnet |
[production] |
| 10:46 |
<vgutierrez> |
disable puppet on acme-chief clients |
[production] |
| 10:45 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-conf1001.eqiad.wmnet |
[production] |
| 10:43 |
<effie> |
reboot mc2036 - T269596 |
[production] |
| 10:40 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test1001.eqiad.wmnet |
[production] |
| 10:27 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief-test1001.eqiad.wmnet |
[production] |
| 10:26 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test2001.codfw.wmnet |
[production] |
| 10:21 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host acmechief-test2001.codfw.wmnet |
[production] |
| 10:10 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1001.eqiad.wmnet |
[production] |
| 10:07 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host an-test-client1001.eqiad.wmnet |
[production] |
| 10:02 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) |
[production] |
| 09:58 |
<reedy@deploy1001> |
Synchronized php-1.36.0-wmf.26/extensions/GrowthExperiments/includes/NewcomerTasks/TaskSuggester/CacheDecorator.php: T272103 (duration: 00m 57s) |
[production] |
| 09:49 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 09:36 |
<vgutierrez> |
rolling restart acme-chief servers to catch up on kernel upgrades |
[production] |
| 09:24 |
<jynus> |
rolling restart of dbprov1* hosts |
[production] |
| 09:18 |
<godog> |
swift codfw-prod: more weight to ms-be20[58-61] - T269337 |
[production] |
| 09:07 |
<moritzm> |
installing bast5002 T257324 |
[production] |
| 08:45 |
<moritzm> |
installing bast4003 T257324 |
[production] |
| 08:39 |
<marostegui> |
Restart clouddb1013-clouddb1020 |
[production] |
| 08:28 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 08:28 |
<ryankemper> |
WDQS puppet run successful |
[production] |
| 08:15 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 08:15 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 08:01 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 07:59 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |