2021-01-07
§
|
14:59 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
14:58 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 00m 03s) |
[production] |
14:58 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
14:58 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host (duration: 02m 04s) |
[production] |
14:57 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
14:56 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: trying to debug a compression error that doesn't happen on the test host |
[production] |
14:54 |
<kormat@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
14:54 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
14:54 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 02m 05s) |
[production] |
14:52 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
14:51 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) |
[production] |
14:51 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
14:51 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev (duration: 01m 53s) |
[production] |
14:49 |
<kormat@cumin1001> |
END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) |
[production] |
14:49 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh cloudweb2001-dev |
[production] |
14:46 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 03m 39s) |
[production] |
14:43 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
14:42 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels (duration: 00m 04s) |
[production] |
14:42 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: refresh labweb1002 with buster-ready wheels |
[production] |
14:40 |
<kormat@cumin1001> |
START - Cookbook sre.ganeti.makevm |
[production] |
14:33 |
<jayme@deploy1001> |
helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. |
[production] |
14:32 |
<jayme> |
imported calico 3.17.0-2 to component/calico-future stretch-wikimedia |
[production] |
14:32 |
<jayme@deploy1001> |
helmfile [staging-codfw] START helmfile.d/admin 'sync'. |
[production] |
14:08 |
<moritzm> |
installing sqlite3 security updates on buster |
[production] |
12:42 |
<_joe_> |
running puppet on logstash1007, elasticsearch oomkilled |
[production] |
12:24 |
<marostegui> |
Deploy schema change on s2 primary master with replication T270053 |
[production] |
12:21 |
<kart_> |
EU-Mid day backport window done. |
[production] |
12:12 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:654734|Enable ContentTranslation in Tsonga Wikipedia as a default tool (T271204)]] (duration: 01m 09s) |
[production] |
12:02 |
<XioNoX> |
push "Allow specific flows from 172.16/12 to prod + default permit" - T209082 |
[production] |
10:51 |
<godog> |
swift eqiad-prod: add weight to ms-be106[0-3] - T268435 |
[production] |
10:06 |
<godog> |
bounce apache on prometheus codfw |
[production] |
09:37 |
<moritzm> |
installing nodejs security updates on buster |
[production] |
09:27 |
<XioNoX> |
push new pfw policies - T271384 |
[production] |
09:17 |
<XioNoX> |
re-pool eqsin - T267544 |
[production] |
08:57 |
<XioNoX> |
re-enable BGP on cr2-eqsin - T267544 |
[production] |
08:14 |
<XioNoX> |
shutdown cr2-eqsin - T267544 |
[production] |
07:43 |
<moritzm> |
installing libxml2 security updates on buster |
[production] |
07:19 |
<XioNoX> |
depool eqsin for router replacement - T267544 |
[production] |
04:12 |
<andrew@deploy1001> |
Finished deploy [striker/deploy@e4db843]: update codfw1dev striker (duration: 00m 48s) |
[production] |
04:11 |
<andrew@deploy1001> |
Started deploy [striker/deploy@e4db843]: update codfw1dev striker |
[production] |
02:57 |
<andrew@deploy1001> |
Finished deploy [striker/deploy@e120c6c]: update codfw1dev striker (duration: 00m 05s) |
[production] |
02:57 |
<andrew@deploy1001> |
Started deploy [striker/deploy@e120c6c]: update codfw1dev striker |
[production] |
02:49 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch (duration: 01m 48s) |
[production] |
02:48 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@ce4c515]: update codfw1dev deploy from train-buster branch |
[production] |
00:50 |
<eileen> |
civicrm revision changed from 95fefcb421 to 2df572bdcd, config revision is 603c0ff4a0 |
[production] |
00:44 |
<shdubsh> |
restart elasticsearch on logstash1011 - oom |
[production] |