|
2020-02-13
ยง
|
| 12:28 |
<vgutierrez> |
pool cp10[77,78] running buster - T242093 |
[production] |
| 12:20 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:571956|Revert: Triple the factor of WDQS lag to maxlag for Wikidata (T244722)]] (duration: 01m 04s) |
[production] |
| 12:18 |
<XioNoX> |
re-image ping2001 to buster - T244584 |
[production] |
| 12:16 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:15 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 1c81925: Create Test Custodians group at Beta Wikiversity (T240438) (duration: 01m 07s) |
[production] |
| 12:13 |
<XioNoX> |
disable ping offload in codfw |
[production] |
| 12:13 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:13 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:13 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 0f035e4: Update wgAvailableRights declaration of autoreviewprotected (T230103) (duration: 01m 03s) |
[production] |
| 12:11 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:08 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 176b0e8: Grant autopatrol to azwiki patrollers (T244338) (duration: 01m 05s) |
[production] |
| 11:53 |
<vgutierrez> |
depool cp10[77,78] and reimage as buster - T242093 |
[production] |
| 11:52 |
<vgutierrez> |
pool cp10[79,80] running buster - T242093 |
[production] |
| 11:40 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:37 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:37 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 11:35 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 11:18 |
<vgutierrez> |
rolling upgrade of ATS to version 8.0.5-1wm16 fleet wide - T244464 |
[production] |
| 11:16 |
<vgutierrez> |
depool cp10[79,80] and reimage as buster - T242093 |
[production] |
| 11:12 |
<ema> |
A:cp re-enable puppet, leave it to cron to apply wikimedia-common/wikimedia-frontend VCL merge T241239 |
[production] |
| 11:08 |
<vgutierrez> |
upload trafficserver 8.0.5-1wm16 to apt.wm.o (buster) - T244464 |
[production] |
| 11:02 |
<vgutierrez> |
pool cp10[81,82] and reimage as buster - T242093 |
[production] |
| 10:59 |
<ema> |
cp4021 (cache_upload): apply wikimedia-common/wikimedia-frontend VCL merge T241239 |
[production] |
| 10:49 |
<ema> |
cp4027 (cache_text): apply wikimedia-common/wikimedia-frontend VCL merge T241239 |
[production] |
| 10:46 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:44 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:44 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:41 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:24 |
<vgutierrez> |
depool cp10[81,82] and reimage as buster - T242093 |
[production] |
| 10:23 |
<vgutierrez> |
removing /root/.ssh/known_hosts in cumin1001 |
[production] |
| 10:21 |
<vgutierrez> |
pool cp10[83,84] running buster - T242093 |
[production] |
| 10:08 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:06 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 10:06 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 10:03 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 09:45 |
<vgutierrez> |
depool cp10[83,84] and reimage as buster - T242093 |
[production] |
| 09:45 |
<vgutierrez> |
pool cp10[85,86] running buster - T242093 |
[production] |
| 09:10 |
<moritzm> |
installing Java security updates on elastic* and relforge* |
[production] |
| 08:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Increase weight for db1107 50 -> 100 for 10.4 testing - T242702', diff saved to https://phabricator.wikimedia.org/P10403 and previous config saved to /var/cache/conftool/dbconfig/20200213-085957-marostegui.json |
[production] |
| 08:57 |
<gehel> |
restart elasticsearch on elastic2051 - JVM upgrade |
[production] |
| 08:21 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:18 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 08:17 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 08:15 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 07:57 |
<moritzm> |
installing Java security updates on Hadoop, Kafka/Jumbo, AQS and Druid canaries |
[production] |
| 07:57 |
<vgutierrez> |
depool cp10[85,86] and reimage as buster - T242093 |
[production] |
| 07:53 |
<moritzm> |
rolling restart of restbase-dev to pick up Java security update |
[production] |
| 07:49 |
<vgutierrez> |
pool cp10[87,88] running buster - T242093 |
[production] |
| 07:49 |
<vgutierrez> |
testing ATS 8.0.5-1wm16 + KA between ats-tls and varnish-fe in cp4031 - T244464 |
[production] |
| 07:47 |
<moritzm> |
installing Java security updates on stat/SWAP hosts |
[production] |