351-400 of 10000 results (23ms)
2021-02-19 ยง
22:10 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet [production]
22:09 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet [production]
22:08 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1261.eqiad.wmnet [production]
21:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2336.codfw.wmnet [production]
21:44 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2336.codfw.wmnet [production]
21:34 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1340.eqiad.wmnet with reason: REIMAGE [production]
21:32 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1340.eqiad.wmnet with reason: REIMAGE [production]
21:27 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1320.eqiad.wmnet with reason: REIMAGE [production]
21:24 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1262.eqiad.wmnet with reason: REIMAGE [production]
21:24 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1320.eqiad.wmnet with reason: REIMAGE [production]
21:22 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2336.codfw.wmnet with reason: REIMAGE [production]
21:22 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1262.eqiad.wmnet with reason: REIMAGE [production]
21:20 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2336.codfw.wmnet with reason: REIMAGE [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1287.eqiad.wmnet [production]
20:57 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1287.eqiad.wmnet [production]
20:51 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2257.codfw.wmnet [production]
20:50 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2257.codfw.cwmnet [production]
20:49 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1270.eqiad.wmnet [production]
20:48 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet [production]
20:42 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1270.eqiad.wmnet [production]
20:42 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1261.eqiad.wmnet [production]
20:42 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1287.eqiad.wmnet [production]
20:33 <mutante> mw1261, mw1270 - scap pull [production]
20:33 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•ž๐Ÿต sudo cumin 'mw1261*,mw1270*,mw1287*' 'depool' [production]
20:32 <mutante> mw1287 - scap pull [production]
20:17 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2257.codfw.wmnet [production]
20:17 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1270.eqiad.wmnet [production]
20:17 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1261.eqiad.wmnet [production]
20:15 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.29 (duration: 01m 42s) [production]
20:06 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.28 (duration: 01m 50s) [production]
20:04 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.27 (duration: 02m 12s) [production]
20:01 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.26 (duration: 02m 12s) [production]
19:57 <dduvall@deploy1001> Pruned MediaWiki: 1.36.0-wmf.25 (duration: 04m 09s) [production]
19:48 <marxarelli> 1.36.0-wmf.31 re-rolled to all wikis (T271345) [production]
19:24 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1287.eqiad.wmnet with reason: REIMAGE [production]
19:22 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1129.eqiad.wmnet with reason: REIMAGE [production]
19:22 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1270.eqiad.wmnet with reason: REIMAGE [production]
19:20 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1287.eqiad.wmnet with reason: REIMAGE [production]
19:19 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1261.eqiad.wmnet with reason: REIMAGE [production]
19:19 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1270.eqiad.wmnet with reason: REIMAGE [production]
19:17 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1261.eqiad.wmnet with reason: REIMAGE [production]
19:11 <dduvall@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.31 [production]
19:01 <dduvall@deploy1001> Synchronized php-1.36.0-wmf.31/extensions/Echo/includes/model/Event.php: backport: [[gerrit:665177|Echo::create: Convert UserIdentityValue to plain User (T275161)]] (duration: 01m 20s) [production]
18:52 <marxarelli> fetching backport https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/665177 for sync prior to all wikis (re)deploy (T275161) [production]
18:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1367.eqiad.wmnet [production]
18:36 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1341.eqiad.wmnet [production]
18:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1367.eqiad.wmnet [production]
18:32 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2272.codfw.wmnet [production]
18:30 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1341.eqiad.wmnet [production]
18:30 <mutante> mw1367 - powercycled - stuck in reboot [production]