3151-3200 of 10000 results (47ms)
2021-01-07 ยง
15:53 <moritzm> installing xorg-server security updates on stretch [production]
15:48 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:46 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:45 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:44 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:14 <kormat@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:11 <kormat@cumin1001> START - Cookbook sre.dns.netbox [production]
15:10 <kormat@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
15:09 <moritzm> installing libmaxminddb security updates on stretch [production]
15:06 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 03m 34s) [production]
15:03 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
15:01 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 25s) [production]
14:59 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) [production]
14:58 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) [production]
14:57 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:56 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:54 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:54 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:54 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) [production]
14:52 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:51 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev (duration: 01m 53s) [production]
14:49 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:49 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev [production]
14:46 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 03m 39s) [production]
14:43 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:42 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:42 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:40 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:33 <jayme@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
14:32 <jayme> imported calico 3.17.0-2 to component/calico-future stretch-wikimedia [production]
14:32 <jayme@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
14:08 <moritzm> installing sqlite3 security updates on buster [production]
12:42 <_joe_> running puppet on logstash1007, elasticsearch oomkilled [production]
12:24 <marostegui> Deploy schema change on s2 primary master with replication T270053 [production]
12:21 <kart_> EU-Mid day backport window done. [production]
12:12 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:654734|Enable ContentTranslation in Tsonga Wikipedia as a default tool (T271204)]] (duration: 01m 09s) [production]
12:02 <XioNoX> push "Allow specific flows from 172.16/12 to prod + default permit" - T209082 [production]
10:51 <godog> swift eqiad-prod: add weight to ms-be106[0-3] - T268435 [production]
10:06 <godog> bounce apache on prometheus codfw [production]
09:37 <moritzm> installing nodejs security updates on buster [production]
09:27 <XioNoX> push new pfw policies - T271384 [production]
09:17 <XioNoX> re-pool eqsin - T267544 [production]
08:57 <XioNoX> re-enable BGP on cr2-eqsin - T267544 [production]
08:14 <XioNoX> shutdown cr2-eqsin - T267544 [production]
07:43 <moritzm> installing libxml2 security updates on buster [production]
07:19 <XioNoX> depool eqsin for router replacement - T267544 [production]