2021-09-28
§
|
07:14 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
06:54 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1001.eqiad.wmnet |
[production] |
06:52 |
<volans@cumin2002> |
END (FAIL) - Cookbook sre.experimental.reimage (exit_code=99) for host sretest1002.eqiad.wmnet |
[production] |
06:52 |
<volans@cumin2002> |
START - Cookbook sre.experimental.reimage for host sretest1002.eqiad.wmnet |
[production] |
06:42 |
<volans> |
installed spicerack 1.0.2 on cumin2002 |
[production] |
05:10 |
<marostegui> |
Remove flaggedimages from s6 T290340 |
[production] |
02:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:15 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
02:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
01:26 |
<eileen> |
civicrm revision changed from ef5367bffc to b8f756b60e, config revision is 77cb7ec866 |
[production] |
2021-09-27
§
|
23:42 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:40 |
<krinkle@deploy1002> |
Synchronized docroot/wikipedia.org/speed-tests/: I82f0727e8eb5b6e5e3e873f9bf0155cbd8668b53 (duration: 00m 59s) |
[production] |
23:39 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:30 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
23:17 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 1891d28b387bc5f7521907d31c04544d2aa271d8: Deploy Growth features to 100% of newcomers of small wikis (T291876) (duration: 00m 57s) |
[production] |
22:58 |
<legoktm@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
22:57 |
<legoktm@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'shellbox-syntaxhighlight' for release 'main' . |
[production] |
22:48 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:44 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:34 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have SyntaxHighlight use Shellbox on group1 wikis too (T289227) (duration: 00m 57s) |
[production] |
22:31 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:27 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 56s) |
[production] |
22:26 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have PdfHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) |
[production] |
22:25 |
<legoktm@deploy1002> |
sync-file aborted: Have PdfHandler use Shellbox service on group0 wikis (T289228) (duration: 00m 00s) |
[production] |
22:23 |
<maryum> |
deployed security patch for T291696 |
[production] |
22:14 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (2/2) (duration: 00m 58s) |
[production] |
22:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
22:13 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Have PagedTiffHandler use Shellbox service on group0 wikis (T289228) (1/2) (duration: 00m 57s) |
[production] |
22:11 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:41 |
<tzatziki> |
re-running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections (in a screen this time) (https://phabricator.wikimedia.org/T291668) |
[production] |
21:37 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:36 |
<mutante> |
puppetmaster2001 - systemctl disable sync-puppet-ca, systemctl unmask sync-puppet-ca, rm /usr/lib/systemd/system/sync-puppet-ca.*, systemctl stop sync-puppet-ca.timer |
[production] |
21:34 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:34 |
<pt1979@cumin2002> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
21:33 |
<tzatziki> |
running `extensions/SecurePoll/cli/wm-scripts/makeGlobalVoterList.php` for MCDC elections |
[production] |
21:29 |
<mutante> |
puppetmaster2001 - rm /usr/lib/systemd/system/sync-puppet-ca.* |
[production] |
21:28 |
<pt1979@cumin2002> |
START - Cookbook sre.dns.netbox |
[production] |
21:25 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:24 |
<mutante> |
puppetmaster2001 systemctl reset-failed |
[production] |
21:22 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:20 |
<legoktm@deploy1002> |
Synchronized wmf-config/CommonSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (2/2) (duration: 00m 56s) |
[production] |
21:18 |
<legoktm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Set $wgTimelineFonts and send all Timeline generation to Shellbox (T289226) (1/2) (duration: 00m 56s) |
[production] |
21:16 |
<mutante> |
puppetmaster2001 - /usr/bin/rsync -avz --delete puppetmaster1001.eqiad.wmnet::puppet_ca /var/lib/puppet/server/ssl/ca |
[production] |
21:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:10 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:01 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
21:01 |
<legoktm@deploy1002> |
Synchronized docroot/: Configure Timeline like most other extensions (4/3) (duration: 00m 56s) |
[production] |