2021-02-22
ยง
|
23:27 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs1014.eqiad.wmnet with reason: REIMAGE |
[production] |
23:25 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on aqs1014.eqiad.wmnet with reason: REIMAGE |
[production] |
23:22 |
<oblivian@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
23:22 |
<oblivian@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
23:19 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@3de01b5]: Fix camus |
[production] |
23:18 |
<oblivian@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
23:18 |
<oblivian@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
23:09 |
<ppchelko@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
23:09 |
<ppchelko@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
23:06 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1410.eqiad.wmnet |
[production] |
23:06 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1412.eqiad.wmnet |
[production] |
23:02 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1412.eqiad.wmnet |
[production] |
23:00 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1410.eqiad.wmnet |
[production] |
22:52 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1286.eqiad.wmnet with reason: REIMAGE |
[production] |
22:50 |
<legoktm> |
disabling puppet on mwdebug1001 to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/664903 |
[production] |
22:49 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1286.eqiad.wmnet with reason: REIMAGE |
[production] |
22:45 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1412.eqiad.wmnet with reason: REIMAGE |
[production] |
22:43 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1410.eqiad.wmnet with reason: REIMAGE |
[production] |
22:42 |
<krinkle@deploy1001> |
Synchronized w/fatal-error.php: df694d695 (duration: 00m 56s) |
[production] |
22:42 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1412.eqiad.wmnet with reason: REIMAGE |
[production] |
22:41 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1410.eqiad.wmnet with reason: REIMAGE |
[production] |
22:31 |
<ppchelko@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
22:31 |
<ppchelko@deploy1001> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
22:18 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1279.eqiad.wmnet |
[production] |
22:18 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1312.eqiad.wmnet |
[production] |
22:16 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1314.eqiad.wmnet |
[production] |
21:46 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1314.eqiad.wmnet |
[production] |
21:46 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1279.eqiad.wmnet |
[production] |
21:45 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1312.eqiad.wmnet |
[production] |
21:00 |
<Amir1> |
end of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T273463 T271985 T273468) |
[production] |
20:59 |
<sbassett> |
Deployed security patch for T274883 |
[production] |
20:59 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1279.eqiad.wmnet with reason: REIMAGE |
[production] |
20:57 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1279.eqiad.wmnet with reason: REIMAGE |
[production] |
20:50 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1312.eqiad.wmnet with reason: REIMAGE |
[production] |
20:48 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1312.eqiad.wmnet with reason: REIMAGE |
[production] |
20:46 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1314.eqiad.wmnet with reason: REIMAGE |
[production] |
20:44 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1314.eqiad.wmnet with reason: REIMAGE |
[production] |
20:39 |
<Amir1> |
start of foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol https (T273463 T271985 T273468) |
[production] |
20:29 |
<mutante> |
mw1279 (canary) - reimaging to buster |
[production] |
20:29 |
<mutante> |
mw1279 (canary) - reimaging to stretch |
[production] |
20:27 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1349.eqiad.wmnet |
[production] |
20:25 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1349.eqiad.wmnet |
[production] |
20:19 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1316.eqiad.wmnet |
[production] |
20:16 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1316.eqiad.wmnet |
[production] |
20:15 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1315.eqiad.wmnet |
[production] |
20:08 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw1315.eqiad.wmnet |
[production] |
20:06 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1349.eqiad.wmnet with reason: REIMAGE |
[production] |
20:04 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mw1349.eqiad.wmnet with reason: REIMAGE |
[production] |
19:36 |
<urbanecm@deploy1001> |
Synchronized wmf-config/config/rowiki.yaml: fc7b071b98b2c14d45259212bd6bea858e3f5aa7: Enable GrowthExperiments on rowiki (T275130; 3/3) (duration: 00m 55s) |
[production] |
19:35 |
<urbanecm@deploy1001> |
Synchronized dblists/growthexperiments.dblist: fc7b071b98b2c14d45259212bd6bea858e3f5aa7: Enable GrowthExperiments on rowiki (T275130; 2/3) (duration: 00m 55s) |
[production] |