|
2020-02-12
ยง
|
| 12:19 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:571705|Triple the factor of WDQS lag to maxlag for Wikidata (T244722)]] (duration: 01m 04s) |
[production] |
| 12:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:12 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit|571412|Enable ContentTranslation out of beta in bs and mk WPs (T244139, T244140)]] (duration: 01m 15s) |
[production] |
| 12:08 |
<vgutierrez> |
depool cp2013 and reimage as buster - T242093 |
[production] |
| 12:06 |
<vgutierrez> |
pool cp2016 running buster - T242093 |
[production] |
| 12:01 |
<vgutierrez> |
depool cp20[16,22] and reimage as buster - T242093 |
[production] |
| 11:57 |
<vgutierrez> |
pool cp20[19,24] running buster - T242093 |
[production] |
| 11:53 |
<akosiaris> |
mangle sessionstore on mw1331 so that it is unreachable. Testing for T243106 |
[production] |
| 11:49 |
<vgutierrez> |
repooling cp40[26,32] |
[production] |
| 11:39 |
<vgutierrez> |
pool cp3050 running buster - T242093 |
[production] |
| 11:37 |
<vgutierrez> |
depooling cp[4026,4032] |
[production] |
| 11:35 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:33 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:32 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:30 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:19 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:18 |
<vgutierrez> |
depool cp2024 and reimage as buster - T242093 |
[production] |
| 11:17 |
<vgutierrez> |
pool cp2025 running buster - T242093 |
[production] |
| 11:16 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:15 |
<vgutierrez> |
depool cp2016 and reimage as buster - T242093 |
[production] |
| 11:14 |
<vgutierrez> |
pool cp2019 running buster - T242093 |
[production] |
| 11:11 |
<moritzm> |
reimage logstash2026 to test new standard RAID0 partman recipe |
[production] |
| 11:05 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:03 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:03 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:00 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:50 |
<vgutierrez> |
depool cp3050 and reimage as buster - T242093 |
[production] |
| 10:49 |
<vgutierrez> |
pool cp30[51,52] running buster - T242093 |
[production] |
| 10:45 |
<vgutierrez> |
depool cp20[19,25] and reimage as buster - T242093 |
[production] |
| 10:42 |
<vgutierrez> |
pool cp2026 running buster - T242093 |
[production] |
| 10:36 |
<vgutierrez> |
pool cp2023 running buster - T242093 |
[production] |
| 10:34 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:34 |
<moritzm> |
bouncing ferm on ganeti1016, failed to start after boot |
[production] |
| 10:32 |
<vgutierrez> |
Enable KA between ats-tls and varnish-fe on cp4031 - T244464 |
[production] |
| 10:31 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:30 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:29 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:29 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:27 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:25 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:23 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:12 |
<vgutierrez> |
testing trafficserver 8.0.6-rc0 in cp40[26,32] |
[production] |
| 10:06 |
<vgutierrez> |
depool cp20[23,26] and reimage as buster - T242093 |
[production] |
| 10:01 |
<vgutierrez> |
depool cp30[51-52] and reimage as buster - T242093 |
[production] |
| 09:38 |
<ema> |
cp: rolling ats-tls-restart to enable analytics logging T237993 |
[production] |
| 09:26 |
<ema> |
cp4027: ats-tls-restart to enable analytics logging to pipe T237993 |
[production] |
| 09:25 |
<moritzm> |
rolling restart of cassandra on restbase-dev to pick up Java security updates |
[production] |
| 09:17 |
<marostegui> |
Failover m2 master dbproxy from dbproxy1007 to dbproxy1013 - T202367 |
[production] |
| 09:13 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 09:11 |
<marostegui> |
Upgrade and reboot dbproxy1013 before making it master - T202367 |
[production] |