|
2020-02-10
ยง
|
| 15:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1107 after first day of 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10366 and previous config saved to /var/cache/conftool/dbconfig/20200210-154552-marostegui.json |
[production] |
| 15:41 |
<pt1979@cumin2001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 15:41 |
<pt1979@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:33 |
<godog> |
roll restart cassandra on session* to apply logging changes - T242585 |
[production] |
| 15:23 |
<moritzm> |
uploading debdeploy 0.0.99.13 to apt.wikimedia.org |
[production] |
| 15:22 |
<godog> |
roll restart cassandra on restbase* to apply logging changes - T242585 |
[production] |
| 15:19 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 15:19 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:19 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 15:19 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:06 |
<marostegui> |
Reload haproxy on dbproxy1017 and dbproxy1017 - T244209 |
[production] |
| 15:04 |
<twentyafterfour@deploy1001> |
Finished scap: full scap sync prior to wmf.18 rollout (duration: 20m 13s) |
[production] |
| 15:04 |
<godog> |
roll restart cassandra on maps* to apply logging changes - T242585 |
[production] |
| 15:03 |
<vgutierrez> |
rolling restart of ats-tls - T240950 |
[production] |
| 15:01 |
<godog> |
roll restart cassandra on maps* to apply logging changes - T242585 |
[production] |
| 15:01 |
<godog> |
roll restart cassandra on maps* to apply logging changes - T242585 |
[production] |
| 15:00 |
<marostegui> |
Restart mysql on m5 master (wikitech will go down) - T244209 |
[production] |
| 14:52 |
<vgutierrez> |
rolling restart of ats-tls in ulsfo - T244464 |
[production] |
| 14:46 |
<vgutierrez> |
depool cp5002 and cp5009 and reimage as buster - T242093 |
[production] |
| 14:44 |
<twentyafterfour@deploy1001> |
Started scap: full scap sync prior to wmf.18 rollout |
[production] |
| 14:42 |
<vgutierrez> |
repool cp5003 and cp5010 running buster - T242093 |
[production] |
| 14:41 |
<marostegui> |
Full-upgrade db1133 (without restarting mysql) - T244209 |
[production] |
| 14:40 |
<twentyafterfour> |
MediaWiki Train: Running a full scap to prepare for moving forward to 1.35.0-wmf.18 ( T233866 ) |
[production] |
| 14:32 |
<marostegui> |
Downtime m5 hosts for the upcoming maintenance - T244209 |
[production] |
| 14:19 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |
| 14:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:11 |
<XioNoX> |
remove TCP-MSS clamping on cr3-knams |
[production] |
| 13:48 |
<vgutierrez> |
depool cp5003 and reimage as buster - T242093 |
[production] |
| 13:47 |
<vgutierrez> |
pooling cp5004 with buster - T242093 |
[production] |
| 13:46 |
<vgutierrez> |
depool cp5010 and reimage as buster - T242093 |
[production] |
| 13:45 |
<vgutierrez> |
pooling cp5011 with buster - T242093 |
[production] |
| 13:28 |
<godog> |
roll restart cassandra on aqs to apply logging changes - T242585 |
[production] |
| 13:03 |
<ladsgroup@deploy1001> |
Synchronized php-1.35.0-wmf.18/extensions/Wikibase: [[gerrit:570911|Revert "wbterms: Set default for the term store to read new"]] (T244529) (duration: 01m 00s) |
[production] |
| 13:03 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 13:00 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:59 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:58 |
<Urbanecm> |
EU SWAT is done |
[production] |
| 12:58 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:56 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 989c9f8: Revert "Revert "Remove handler deleted from the MachineVision extension"" (duration: 00m 58s) |
[production] |
| 12:51 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 989c9f8: Revert "Revert "Remove handler deleted from the MachineVision extension"" (duration: 00m 59s) |
[production] |
| 12:49 |
<urbanecm@deploy1001> |
Finished scap: SWAT: 799224f: 137a40e (T241242; T243974) (duration: 20m 18s) |
[production] |
| 12:30 |
<vgutierrez> |
depool cp5004 and reimage as buster - T242093 |
[production] |
| 12:29 |
<vgutierrez> |
pooling cp5005 with buster - T242093 |
[production] |
| 12:28 |
<urbanecm@deploy1001> |
Started scap: SWAT: 799224f: 137a40e (T241242; T243974) |
[production] |
| 12:23 |
<vgutierrez> |
pooling ncredir1001 with buster - T243391 |
[production] |
| 12:18 |
<_joe_> |
running puppet, scap pull on mwdebug1001 |
[production] |
| 12:17 |
<vgutierrez> |
upload trafficserver 8.0.5-1wm15 to apt.wm.o (buster) - T244538 |
[production] |
| 12:08 |
<vgutierrez@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) |
[production] |