4051-4100 of 10000 results (24ms)
2020-09-25 §
16:29 <pt1979@cumin2001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:23 <pt1979@cumin2001> START - Cookbook sre.dns.netbox [production]
15:23 <jynus> fixing enwikivoyage ipblocks inconsistency cluster-wide T263842 [production]
14:54 <elukey> install linux-image-4.19-amd64 on an-worker1096 + reboot [production]
12:41 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:41 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:21 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:21 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
12:13 <kormat@cumin1001> dbctl commit (dc=all): 'Add db2113 to various groups T263842', diff saved to https://phabricator.wikimedia.org/P12797 and previous config saved to /var/cache/conftool/dbconfig/20200925-121332-kormat.json [production]
11:25 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
11:23 <jmm@cumin1001> START - Cookbook sre.hosts.downtime [production]
11:10 <moritzm> reimaging sretest1001 to validate puppetised sources.list with a new installation T158562 [production]
10:42 <jmm@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
10:40 <jmm@cumin1001> START - Cookbook sre.hosts.downtime [production]
10:28 <moritzm> reimaging sretest1002 to validate puppetised sources.list with a new installation T158562 [production]
09:58 <moritzm> restarting archiva to pick up Java security update [production]
09:22 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:22 <ema> upload@eqsin: rolling varnish upgrade to 6.0.6-1wm1 T263557 [production]
09:20 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
09:02 <ema> text@eqsin: rolling varnish upgrade to 6.0.6-1wm1 T263557 [production]
06:50 <elukey> shutdown ganeti5002 (mistakenly powercycled it without seeing T261130) [production]
06:40 <elukey> powercycle ganeti5002 (no instances running on it, mgmt console shows no tty usable) [production]
06:34 <elukey> reboot stat1004 to pick up kernel settings [production]
03:10 <ejegg> updated payments-wiki from f89c594e12 to b2eb456ed1 [production]
02:29 <ppchelko@deploy1001> Finished deploy [restbase/deploy@4eaad8f]: new codfw, T263798 (duration: 09m 05s) [production]
02:27 <andrew@deploy1001> Finished deploy [horizon/deploy@7b61460]: (no justification provided) (duration: 00m 07s) [production]
02:27 <andrew@deploy1001> Started deploy [horizon/deploy@7b61460]: (no justification provided) [production]
02:20 <ppchelko@deploy1001> Started deploy [restbase/deploy@4eaad8f]: new codfw, T263798 [production]
02:20 <ppchelko@deploy1001> Finished deploy [restbase/deploy@4eaad8f]: eqiad-only, T263798 (duration: 06m 09s) [production]
02:14 <ppchelko@deploy1001> Started deploy [restbase/deploy@4eaad8f]: eqiad-only, T263798 [production]
2020-09-24 §
23:39 <andrew@deploy1001> Finished deploy [horizon/deploy@7b61460]: (no justification provided) (duration: 01m 58s) [production]
23:37 <andrew@deploy1001> Started deploy [horizon/deploy@7b61460]: (no justification provided) [production]
21:40 <mutante> mw1349 - systemctl reset-failed [production]
21:03 <cdanis> reprepro: add backported ipvsadm 1:1.31-1+deb10u1 to buster-wikimedia [production]
21:00 <andrew@deploy1001> Finished deploy [horizon/deploy@404e205]: (no justification provided) (duration: 01m 05s) [production]
20:59 <andrew@deploy1001> Started deploy [horizon/deploy@404e205]: (no justification provided) [production]
20:41 <andrew@deploy1001> Finished deploy [horizon/deploy@24368a5]: (no justification provided) (duration: 02m 10s) [production]
20:39 <andrew@deploy1001> Started deploy [horizon/deploy@24368a5]: (no justification provided) [production]
20:35 <andrew@deploy1001> Finished deploy [horizon/deploy@85125d1]: (no justification provided) (duration: 00m 52s) [production]
20:34 <andrew@deploy1001> Started deploy [horizon/deploy@85125d1]: (no justification provided) [production]
19:57 <mholloway-shell@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
19:55 <mholloway-shell@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
19:54 <mholloway-shell@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
19:47 <ebernhardson@deploy1001> Synchronized wmf-config/ProductionServices.php: Revert: cloudelastic: envoy sits in front now (duration: 00m 59s) [production]
19:41 <andrew@deploy1001> Finished deploy [horizon/deploy@e5890b9]: (no justification provided) (duration: 00m 36s) [production]
19:41 <andrew@deploy1001> Started deploy [horizon/deploy@e5890b9]: (no justification provided) [production]
19:39 <andrew@deploy1001> Finished deploy [horizon/deploy@e5890b9]: (no justification provided) (duration: 01m 08s) [production]
19:38 <andrew@deploy1001> Started deploy [horizon/deploy@e5890b9]: (no justification provided) [production]
19:30 <andrew@deploy1001> Finished deploy [horizon/deploy@e5890b9]: dev (duration: 00m 44s) [production]
19:29 <andrew@deploy1001> Started deploy [horizon/deploy@e5890b9]: dev [production]