|
2021-02-10
ยง
|
| 14:41 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp5004.eqsin.wmnet |
[production] |
| 14:41 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp5010.eqsin.wmnet |
[production] |
| 14:41 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp4024.ulsfo.wmnet |
[production] |
| 14:40 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp4030.ulsfo.wmnet |
[production] |
| 14:40 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp3057.esams.wmnet |
[production] |
| 14:39 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp3056.esams.wmnet |
[production] |
| 14:39 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp2034.codfw.wmnet |
[production] |
| 14:39 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp1082.eqiad.wmnet |
[production] |
| 14:39 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp1081.eqiad.wmnet |
[production] |
| 12:26 |
<dcausse@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T269619: [wdqs] Add flink sideoutput stream definitions (duration: 01m 06s) |
[production] |
| 12:20 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:658321|Remove Wikibase.NewItemIdFormatter log channel (T268870)]] 2/2 (prod no-op) (duration: 01m 08s) |
[production] |
| 12:18 |
<lucaswerkmeister-wmde@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:658321|Remove Wikibase.NewItemIdFormatter log channel (T268870)]] 1/2 (duration: 01m 07s) |
[production] |
| 12:11 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: e8214ee812f3812f609c26d6422b85a99a91e1f6: Enable GrowthExperiments on bnwiki (T266020) (duration: 01m 08s) |
[production] |
| 12:07 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 2d8cb10f246904f1af07b019da270fd8dc7816fa: Set wgGEHelpPanelAskMentor to true for several wikis (T272753) (duration: 01m 21s) |
[production] |
| 12:05 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5003.eqsin.wmnet |
[production] |
| 12:01 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4029.ulsfo.wmnet |
[production] |
| 11:56 |
<vgutierrez> |
powercycle cp5003 |
[production] |
| 11:55 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3055.esams.wmnet |
[production] |
| 11:55 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5009.eqsin.wmnet |
[production] |
| 11:54 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1080.eqiad.wmnet |
[production] |
| 11:54 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3054.esams.wmnet |
[production] |
| 11:54 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1079.eqiad.wmnet |
[production] |
| 11:54 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2032.codfw.wmnet |
[production] |
| 11:54 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2031.codfw.wmnet |
[production] |
| 11:45 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp5003.eqsin.wmnet |
[production] |
| 11:45 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp5009.eqsin.wmnet |
[production] |
| 11:44 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp4029.ulsfo.wmnet |
[production] |
| 11:44 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp3055.esams.wmnet |
[production] |
| 11:43 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp3054.esams.wmnet |
[production] |
| 11:43 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp2032.codfw.wmnet |
[production] |
| 11:43 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp2031.codfw.wmnet |
[production] |
| 11:43 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp1080.eqiad.wmnet |
[production] |
| 11:42 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp1079.eqiad.wmnet |
[production] |
| 11:28 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4023.ulsfo.wmnet |
[production] |
| 11:22 |
<legoktm@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1404.eqiad.wmnet |
[production] |
| 11:18 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp4023.ulsfo.wmnet |
[production] |
| 11:00 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5008.eqsin.wmnet |
[production] |
| 10:46 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1127 (re)pooling @ 100%: Slowly repool db1127', diff saved to https://phabricator.wikimedia.org/P14301 and previous config saved to /var/cache/conftool/dbconfig/20210210-104649-root.json |
[production] |
| 10:42 |
<vgutierrez> |
powercycle cp5008 |
[production] |
| 10:40 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4028.ulsfo.wmnet |
[production] |
| 10:40 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp5002.eqsin.wmnet |
[production] |
| 10:40 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp4022.ulsfo.wmnet |
[production] |
| 10:39 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3052.esams.wmnet |
[production] |
| 10:39 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2030.codfw.wmnet |
[production] |
| 10:38 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp3053.esams.wmnet |
[production] |
| 10:38 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2029.codfw.wmnet |
[production] |
| 10:37 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1078.eqiad.wmnet |
[production] |
| 10:37 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp1077.eqiad.wmnet |
[production] |
| 10:31 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1127 (re)pooling @ 80%: Slowly repool db1127', diff saved to https://phabricator.wikimedia.org/P14300 and previous config saved to /var/cache/conftool/dbconfig/20210210-103146-root.json |
[production] |
| 10:28 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host cp5002.eqsin.wmnet |
[production] |