651-700 of 10000 results (34ms)
2021-09-28 §
09:46 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1010.eqiad.wmnet [production]
09:42 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host rdb1010.eqiad.wmnet [production]
09:37 <elukey@cumin1001> END (PASS) - Cookbook sre.kafka.roll-restart-mirror-maker (exit_code=0) restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. - elukey@cumin1001 [production]
09:27 <elukey@cumin1001> START - Cookbook sre.kafka.roll-restart-mirror-maker restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. - elukey@cumin1001 [production]
09:26 <marostegui> Deploy schema change on s4 codfw (lag will show up) T283499 [production]
09:23 <marostegui> Deploy schema change on s2 codfw (lag will show up) T283499 [production]
09:00 <marostegui@cumin1001> END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host db2080.codfw.wmnet [production]
08:57 <effie> upgrade scap on eqiad and codfw - T291095 [production]
08:30 <marostegui@cumin1001> START - Cookbook sre.experimental.reimage for host db2080.codfw.wmnet [production]
08:17 <volans> uploaded spicerack_1.0.3 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia [production]
07:38 <volans@cumin2002> END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1002.eqiad.wmnet [production]
07:21 <volans@cumin2002> END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1001.eqiad.wmnet [production]
07:14 <volans@cumin2002> START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet [production]
06:54 <volans@cumin2002> START - Cookbook sre.experimental.reimage for host sretest1001.eqiad.wmnet [production]
06:52 <volans@cumin2002> END (FAIL) - Cookbook sre.experimental.reimage (exit_code=99) for host sretest1002.eqiad.wmnet [production]
06:52 <volans@cumin2002> START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet [production]
06:42 <volans> installed spicerack 1.0.2 on cumin2002 [production]
05:10 <marostegui> Remove flaggedimages from s6 T290340 [production]
02:42 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:15 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
02:12 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
01:26 <eileen> civicrm revision changed from ef5367bffc to b8f756b60e, config revision is 77cb7ec866 [production]
2021-09-27 §
23:42 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:40 <krinkle@deploy1002> Synchronized docroot/wikipedia.org/speed-tests/: I82f0727e8eb5b6e5e3e873f9bf0155cbd8668b53 (duration: 00m 59s) [production]
23:39 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:30 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:27 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:17 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 1891d28b387bc5f7521907d31c04544d2aa271d8: Deploy Growth features to 100% of newcomers of small wikis (T291876) (duration: 00m 57s) [production]
22:58 <legoktm@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . [production]
22:57 <legoktm@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . [production]
22:48 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:44 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:34 <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Have SyntaxHighlight use Shellbox on group1 wikis too (T289227) (duration: 00m 57s) [production]
22:31 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:27 <legoktm@deploy1002> Synchronized wmf-config/CommonSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 56s) [production]
22:26 <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) [production]
22:25 <legoktm@deploy1002> sync-file aborted: Have PdfHandler use Shellbox service on group0 wikis (T289228) (duration: 00m 00s) [production]
22:23 <maryum> deployed security patch for T291696 [production]
22:14 <legoktm@deploy1002> Synchronized wmf-config/CommonSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 58s) [production]
22:14 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:13 <legoktm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) [production]
22:11 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:41 <tzatziki> re-running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections (in a screen this time) (https://phabricator.wikimedia.org/T291668) [production]
21:37 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:36 <mutante> puppetmaster2001 - systemctl disable sync-puppet-ca, systemctl unmask sync-puppet-ca, rm /usr/lib/systemd/system/sync-puppet-ca.*, systemctl stop sync-puppet-ca.timer [production]
21:34 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
21:34 <pt1979@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
21:33 <tzatziki> running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections [production]