1701-1750 of 10000 results (30ms)
2021-02-05 §
00:59 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@85713c1]: restore data range specifier in extract job partition spec [production]
00:36 <legoktm@cumin1001> conftool action : set/pooled=no; selector: name=mw1278.eqiad.wmnet [production]
00:35 <legoktm> enabled remote IPMI access on mw1349.mgmt.eqiad.wmnet and mw1380.mgmt.eqiad.wmnet [production]
00:24 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@9858513]: transfer_to_es: Wait for link reco, and write to weighted_tags as well (duration: 02m 43s) [production]
00:21 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@9858513]: transfer_to_es: Wait for link reco, and write to weighted_tags as well [production]
2021-02-04 §
23:59 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@93bf374]: correct hql in ores_predictions_init_v3 (duration: 01m 06s) [production]
23:58 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@93bf374]: correct hql in ores_predictions_init_v3 [production]
23:26 <legoktm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1278.eqiad.wmnet with reason: REIMAGE [production]
23:24 <legoktm@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1278.eqiad.wmnet with reason: REIMAGE [production]
23:05 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1397.eqiad.wmnet [production]
23:05 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1396.eqiad.wmnet [production]
23:02 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1396.eqiad.wmnet [production]
23:02 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1397.eqiad.wmnet [production]
23:01 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1311.eqiad.wmnet [production]
22:55 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1263.eqiad.wmnet [production]
22:39 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1263.eqiad.wmnet [production]
22:38 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1311.eqiad.wmnet [production]
22:38 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@700cd49]: partition ores staging tables by data source (duration: 01m 19s) [production]
22:37 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@700cd49]: partition ores staging tables by data source [production]
22:31 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1396.eqiad.wmnet with reason: REIMAGE [production]
22:29 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1397.eqiad.wmnet with reason: REIMAGE [production]
22:28 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1396.eqiad.wmnet with reason: REIMAGE [production]
22:27 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1397.eqiad.wmnet with reason: REIMAGE [production]
21:59 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1399.eqiad.wmnet [production]
21:56 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1398.eqiad.wmnet [production]
21:53 <legoktm@cumin1001> conftool action : set/pooled=yes; selector: name=mw2244.codfw.wmnet [production]
21:52 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1311.eqiad.wmnet with reason: REIMAGE [production]
21:52 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1399.eqiad.wmnet [production]
21:52 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1398.eqiad.wmnet [production]
21:50 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1311.eqiad.wmnet with reason: REIMAGE [production]
21:32 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE [production]
21:30 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1263.eqiad.wmnet with reason: REIMAGE [production]
21:24 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1398.eqiad.wmnet with reason: REIMAGE [production]
21:23 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1399.eqiad.wmnet with reason: REIMAGE [production]
21:22 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1398.eqiad.wmnet with reason: REIMAGE [production]
21:21 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1399.eqiad.wmnet with reason: REIMAGE [production]
21:20 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1308.eqiad.wmnet [production]
21:17 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1308.eqiad.wmnet [production]
20:59 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw1400.eqiad.wmnet [production]
20:56 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2267.codfw.wmnet [production]
20:56 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2267.wmnet [production]
20:38 <legoktm@cumin1001> conftool action : set/pooled=no; selector: name=mw2244.codfw.wmnet [production]
20:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw1400.eqiad.wmnet [production]
20:35 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2267.wmnet [production]
20:25 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1308.eqiad.wmnet with reason: REIMAGE [production]
20:23 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1308.eqiad.wmnet with reason: REIMAGE [production]
20:13 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1400.eqiad.wmnet with reason: REIMAGE [production]
20:11 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2267.codfw.wmnet with reason: REIMAGE [production]
20:10 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw1400.eqiad.wmnet with reason: REIMAGE [production]
20:09 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2267.codfw.wmnet with reason: REIMAGE [production]