1501-1550 of 10000 results (31ms)
2021-01-07 ยง
18:49 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE [production]
18:47 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE [production]
18:46 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE [production]
18:45 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE [production]
18:34 <volans@deploy1001> Finished deploy [homer/deploy@fe7acbc]: Release v0.2.6 (duration: 04m 25s) [production]
18:30 <volans@deploy1001> Started deploy [homer/deploy@fe7acbc]: Release v0.2.6 [production]
16:50 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 50s) [production]
16:47 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:46 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 05s) [production]
16:44 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:44 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 08s) [production]
16:44 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
16:16 <moritzm> installing xerces-c security updates on Buster [production]
15:53 <moritzm> installing xorg-server security updates on stretch [production]
15:48 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:46 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:45 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE [production]
15:44 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE [production]
15:14 <kormat@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:11 <kormat@cumin1001> START - Cookbook sre.dns.netbox [production]
15:10 <kormat@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
15:09 <moritzm> installing libmaxminddb security updates on stretch [production]
15:06 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 03m 34s) [production]
15:03 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
15:01 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 25s) [production]
14:59 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) [production]
14:58 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:58 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) [production]
14:57 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:56 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host [production]
14:54 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:54 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:54 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) [production]
14:52 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:51 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:51 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev (duration: 01m 53s) [production]
14:49 <kormat@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:49 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev [production]
14:46 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 03m 39s) [production]
14:43 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:42 <andrew@deploy1001> Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) [production]
14:42 <andrew@deploy1001> Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels [production]
14:40 <kormat@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:33 <jayme@deploy1001> helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. [production]
14:32 <jayme> imported calico 3.17.0-2 to component/calico-future stretch-wikimedia [production]
14:32 <jayme@deploy1001> helmfile [staging-codfw] START helmfile.d/admin 'sync'. [production]
14:08 <moritzm> installing sqlite3 security updates on buster [production]
12:42 <_joe_> running puppet on logstash1007, elasticsearch oomkilled [production]