3551-3600 of 10000 results (37ms)
2021-01-07 §
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) [production]
14:58 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) [production]
14:57 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:56 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:54 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:54 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:54 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) [production]
14:52 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:51 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev (duration: 01m 53s) [production]
14:49 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:49 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev [production]
14:46 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 03m 39s) [production]
14:43 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:42 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:42 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:40 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:33 <jayme@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
14:32 <jayme> imported calico 3.17.0-2 to component/calico-future stretch-wikimedia [production]
14:32 <jayme@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
14:08 <moritzm> installing sqlite3 security updates on buster [production]
12:42 <_joe_> running puppet on logstash1007, elasticsearch oomkilled [production]
12:24 <marostegui> Deploy schema change on s2 primary master with replication T270053 [production]
12:21 <kart_> EU-Mid day backport window done. [production]
12:12 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:654734|Enable ContentTranslation in Tsonga Wikipedia as a default tool (T271204)]] (duration: 01m 09s) [production]
12:02 <XioNoX> push "Allow specific flows from 172.16/12 to prod + default permit" - T209082 [production]
10:51 <godog> swift eqiad-prod: add weight to ms-be106[0-3] - T268435 [production]
10:06 <godog> bounce apache on prometheus codfw [production]
09:37 <moritzm> installing nodejs security updates on buster [production]
09:27 <XioNoX> push new pfw policies - T271384 [production]
09:17 <XioNoX> re-pool eqsin - T267544 [production]
08:57 <XioNoX> re-enable BGP on cr2-eqsin - T267544 [production]
08:14 <XioNoX> shutdown cr2-eqsin - T267544 [production]
07:43 <moritzm> installing libxml2 security updates on buster [production]
07:19 <XioNoX> depool eqsin for router replacement - T267544 [production]
04:12 <andrew@deploy1001> Finished deploy [striker/deploy@e4db843]: update codfw1dev striker (duration: 00m 48s) [production]
04:11 <andrew@deploy1001> Started deploy [striker/deploy@e4db843]: update codfw1dev striker [production]
02:57 <andrew@deploy1001> Finished deploy [striker/deploy@e120c6c]: update codfw1dev striker (duration: 00m 05s) [production]
02:57 <andrew@deploy1001> Started deploy [striker/deploy@e120c6c]: update codfw1dev striker [production]
02:49 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch (duration: 01m 48s) [production]
02:48 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch [production]
00:50 <eileen> civicrm revision changed from 95fefcb421 to 2df572bdcd, config revision is 603c0ff4a0 [production]
00:44 <shdubsh> restart elasticsearch on logstash1011 - oom [production]
2021-01-06 §
22:34 <sbassett> Deployed security patch for T270988 to wmf.22 [production]
22:32 <sbassett> Deployed security patch for T270988 to wmf.25 [production]
22:17 <legoktm> forced gerrit to replicate RequestTimeout to github (`ssh gerrit.wikimedia.org replication start mediawiki/libs/RequestTimeout --wait`) [production]
21:59 <dwisehaupt> increased batch size for eoy_receipt to 4000 per run when frmx1001 is the primary mx [production]
21:58 <dwisehaupt> process-control config revision is 603c0ff4a0 [production]