|
2021-01-07
ยง
|
| 18:46 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc2027.codfw.wmnet with reason: REIMAGE |
[production] |
| 18:45 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on mc1027.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:34 |
<volans@deploy1001> |
Finished deploy [homer/deploy@fe7acbc]: Release v0.2.6 (duration: 04m 25s) |
[production] |
| 18:30 |
<volans@deploy1001> |
Started deploy [homer/deploy@fe7acbc]: Release v0.2.6 |
[production] |
| 16:50 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 50s) |
[production] |
| 16:47 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:46 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 05s) |
[production] |
| 16:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:44 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 08s) |
[production] |
| 16:44 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 16:16 |
<moritzm> |
installing xerces-c security updates on Buster |
[production] |
| 15:53 |
<moritzm> |
installing xorg-server security updates on stretch |
[production] |
| 15:48 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |
| 15:46 |
<andrew@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 15:45 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on cloudweb2001-dev.wikimedia.org with reason: REIMAGE |
[production] |
| 15:44 |
<andrew@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on labweb1002.wikimedia.org with reason: REIMAGE |
[production] |
| 15:14 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 15:11 |
<kormat@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:10 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) |
[production] |
| 15:09 |
<moritzm> |
installing libmaxminddb security updates on stretch |
[production] |
| 15:06 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 03m 34s) |
[production] |
| 15:03 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 15:01 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 25s) |
[production] |
| 14:59 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 14:58 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) |
[production] |
| 14:58 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 14:58 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) |
[production] |
| 14:57 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 14:56 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
| 14:54 |
<kormat@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 14:54 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 14:54 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) |
[production] |
| 14:52 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
| 14:51 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) |
[production] |
| 14:51 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
| 14:51 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev (duration: 01m 53s) |
[production] |
| 14:49 |
<kormat@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
| 14:49 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev |
[production] |
| 14:46 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 03m 39s) |
[production] |
| 14:43 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
| 14:42 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) |
[production] |
| 14:42 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
| 14:40 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
| 14:33 |
<jayme@deploy1001> |
helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. |
[production] |
| 14:32 |
<jayme> |
imported calico 3.17.0-2 to component/calico-future stretch-wikimedia |
[production] |
| 14:32 |
<jayme@deploy1001> |
helmfile [staging-codfw] START helmfile.d/admin 'sync'. |
[production] |
| 14:08 |
<moritzm> |
installing sqlite3 security updates on buster |
[production] |
| 12:42 |
<_joe_> |
running puppet on logstash1007, elasticsearch oomkilled |
[production] |
| 12:24 |
<marostegui> |
Deploy schema change on s2 primary master with replication T270053 |
[production] |
| 12:21 |
<kart_> |
EU-Mid day backport window done. |
[production] |