|
2021-09-28
§
|
| 09:27 |
<elukey@cumin1001> |
START - Cookbook sre.kafka.roll-restart-mirror-maker restart MirrorMaker for Kafka A:kafka-mirror-maker-test-eqiad cluster: Roll restart of jvm daemons. - elukey@cumin1001 |
[production] |
| 09:26 |
<marostegui> |
Deploy schema change on s4 codfw (lag will show up) T283499 |
[production] |
| 09:23 |
<marostegui> |
Deploy schema change on s2 codfw (lag will show up) T283499 |
[production] |
| 09:00 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host db2080.codfw.wmnet |
[production] |
| 08:57 |
<effie> |
upgrade scap on eqiad and codfw - T291095 |
[production] |
| 08:30 |
<marostegui@cumin1001> |
START - Cookbook sre.experimental.reimage for host db2080.codfw.wmnet |
[production] |
| 08:17 |
<volans> |
uploaded spicerack_1.0.3 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia |
[production] |
| 07:38 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1002.eqiad.wmnet |
[production] |
| 07:21 |
<volans@cumin2002> |
END (PASS) - Cookbook sre.experimental.reimage (exit_code=0) for host sretest1001.eqiad.wmnet |
[production] |
| 07:14 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
| 06:54 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1001.eqiad.wmnet |
[production] |
| 06:52 |
<volans@cumin2002> |
END (FAIL) - Cookbook sre.experimental.reimage (exit_code=99) for host sretest1002.eqiad.wmnet |
[production] |
| 06:52 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
| 06:42 |
<volans> |
installed spicerack 1.0.2 on cumin2002 |
[production] |
| 05:10 |
<marostegui> |
Remove flaggedimages from s6 T290340 |
[production] |
| 02:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 01:26 |
<eileen> |
civicrm revision changed from ef5367bffc to b8f756b60e, config revision is 77cb7ec866 |
[production] |
|
2021-09-27
§
|
| 23:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:40 |
<krinkle@deploy1002> |
Synchronized docroot/wikipedia.org/speed-tests/: I82f0727e8eb5b6e5e3e873f9bf0155cbd8668b53 (duration: 00m 59s) |
[production] |
| 23:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:17 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 1891d28b387bc5f7521907d31c04544d2aa271d8: Deploy Growth features to 100% of newcomers of small wikis (T291876) (duration: 00m 57s) |
[production] |
| 22:58 |
<legoktm@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
| 22:57 |
<legoktm@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
| 22:48 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 22:44 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 22:34 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have SyntaxHighlight use Shellbox on group1 wikis too (T289227) (duration: 00m 57s) |
[production] |
| 22:31 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 22:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 22:27 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 56s) |
[production] |
| 22:26 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) |
[production] |
| 22:25 |
<legoktm@deploy1002> |
sync-file aborted: Have PdfHandler use Shellbox service on group0 wikis (T289228) (duration: 00m 00s) |
[production] |
| 22:23 |
<maryum> |
deployed security patch for T291696 |
[production] |
| 22:14 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 58s) |
[production] |
| 22:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 22:13 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) |
[production] |
| 22:11 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:41 |
<tzatziki> |
re-running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections (in a screen this time) (https://phabricator.wikimedia.org/T291668) |
[production] |
| 21:37 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:36 |
<mutante> |
puppetmaster2001 - systemctl disable sync-puppet-ca, systemctl unmask sync-puppet-ca, rm /usr/lib/systemd/system/sync-puppet-ca.*, systemctl stop sync-puppet-ca.timer |
[production] |
| 21:34 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 21:34 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 21:33 |
<tzatziki> |
running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections |
[production] |
| 21:29 |
<mutante> |
puppetmaster2001 - rm /usr/lib/systemd/system/sync-puppet-ca.* |
[production] |
| 21:28 |
<pt1979@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
| 21:25 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |