2021-09-28
§
|
10:46 |
<jmm@cumin2002> |
START - Cookbook sre.hosts.decommission for hosts testvm2002.codfw.wmnet |
[production] |
10:45 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1012.eqiad.wmnet |
[production] |
10:40 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb1012.eqiad.wmnet |
[production] |
10:32 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2009.codfw.wmnet |
[production] |
10:29 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb2009.codfw.wmnet |
[production] |
10:23 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2007.codfw.wmnet |
[production] |
10:16 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb2007.codfw.wmnet |
[production] |
10:13 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2010.codfw.wmnet |
[production] |
10:10 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.ores.roll-restart-workers (exit_code=0) for ORES codfw cluster: Roll restart of ORES's daemons. - elukey@cumin1001 |
[production] |
10:08 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb2010.codfw.wmnet |
[production] |
10:01 |
<marostegui> |
Deploy schema change on s5 codfw (lag will show up) T283499 |
[production] |
10:00 |
<marostegui> |
Deploy schema change on s7 codfw (lag will show up) T283499 |
[production] |
09:57 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2008.codfw.wmnet |
[production] |
09:50 |
<elukey@cumin1001> |
START - Cookbook sre.ores.roll-restart-workers for ORES codfw cluster: Roll restart of ORES's daemons. - elukey@cumin1001 |
[production] |
09:48 |
<_joe_> |
removing old builds from compiler1002.puppet-diffs.eqiad1.wikimedia.cloud |
[production] |
09:48 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb2008.codfw.wmnet |
[production] |
09:46 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1010.eqiad.wmnet |
[production] |
09:42 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.reboot-single for host rdb1010.eqiad.wmnet |
[production] |
09:37 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.kafka.roll-restart-mirror-maker (exit_code=0) restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. - elukey@cumin1001 |
[production] |
09:27 |
<elukey@cumin1001> |
START - Cookbook sre.kafka.roll-restart-mirror-maker restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. - elukey@cumin1001 |
[production] |
09:26 |
<marostegui> |
Deploy schema change on s4 codfw (lag will show up) T283499 |
[production] |
09:23 |
<marostegui> |
Deploy schema change on s2 codfw (lag will show up) T283499 |
[production] |
09:00 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host db2080.codfw.wmnet |
[production] |
08:57 |
<effie> |
upgrade scap on eqiad and codfw - T291095 |
[production] |
08:30 |
<marostegui@cumin1001> |
START - Cookbook sre.experimental.reimage for host db2080.codfw.wmnet |
[production] |
08:17 |
<volans> |
uploaded spicerack_1.0.3 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia |
[production] |
07:38 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1002.eqiad.wmnet |
[production] |
07:21 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1001.eqiad.wmnet |
[production] |
07:14 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
06:54 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1001.eqiad.wmnet |
[production] |
06:52 |
<volans@cumin2002> |
END (FAIL) - Cookbook sre.experimental.reimage (exit_code=99) for host sretest1002.eqiad.wmnet |
[production] |
06:52 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
06:42 |
<volans> |
installed spicerack 1.0.2 on cumin2002 |
[production] |
05:10 |
<marostegui> |
Remove flaggedimages from s6 T290340 |
[production] |
02:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
01:26 |
<eileen> |
civicrm revision changed from ef5367bffc to b8f756b60e, config revision is 77cb7ec866 |
[production] |
2021-09-27
§
|
23:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:40 |
<krinkle@deploy1002> |
Synchronized docroot/wikipedia.org/speed-tests/: I82f0727e8eb5b6e5e3e873f9bf0155cbd8668b53 (duration: 00m 59s) |
[production] |
23:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:17 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 1891d28b387bc5f7521907d31c04544d2aa271d8: Deploy Growth features to 100% of newcomers of small wikis (T291876) (duration: 00m 57s) |
[production] |
22:58 |
<legoktm@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
22:57 |
<legoktm@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
22:48 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:44 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:34 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have SyntaxHighlight use Shellbox on group1 wikis too (T289227) (duration: 00m 57s) |
[production] |