2021-11-29
ยง
|
12:51 |
<moritzm> |
upgrading ganeti codfw cluster to 2.16 backport T296622 |
[production] |
12:49 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:48 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:36 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:35 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:32 |
<vgutierrez> |
depool cp3064 - T290005 |
[production] |
12:32 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.9/extensions/GrowthExperiments/includes/HomepageModules/SuggestedEdits.php: 05704407395fbf227eec47cf716393dc60a36a35: Fix error handling in SuggestedEdits::getActionData (T296366) (duration: 05m 37s) |
[production] |
12:29 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:17 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:16 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:13 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 7fdea3e71e4fd9e85c30efbc17f94c0711deb252: Add planet4589.org to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T296136) (duration: 00m 56s) |
[production] |
12:11 |
<vgutierrez> |
pool cp3064 (text) using HAProxy as TLS terminator - T290005 |
[production] |
12:10 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:09 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3064.esams.wmnet with OS buster |
[production] |
12:09 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
12:07 |
<urbanecm@deploy1002> |
Synchronized docroot/: 4662224229cb4083b8b01de436ccd65e8c00e7dd: Remove search.wikimedia.org files (T289224) (duration: 00m 56s) |
[production] |
11:02 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
11:01 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:58 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.9/extensions/CentralAuth/includes/CentralAuthUser.php: 5fc6aaa73202a1bf2aa58998d2671d5f4a6255bc: Fix "Mark entries as bot entries" feature(2/2; T296297) (duration: 00m 55s) |
[production] |
10:57 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.9/extensions/CentralAuth/includes/Special/SpecialMultiLock.php: 5fc6aaa73202a1bf2aa58998d2671d5f4a6255bc: Fix "Mark entries as bot entries" feature (1/2; T296297) (duration: 00m 56s) |
[production] |
10:55 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:54 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
10:52 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: d01652ec22f6cb3413b419a3c9b0a7a08d79960f: Disable Growth IP research survey (T294568) (duration: 00m 56s) |
[production] |
10:45 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp3064.esams.wmnet with OS buster |
[production] |
10:45 |
<vgutierrez@cumin1001> |
END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp3064.esams.wmnet with OS buster |
[production] |
10:02 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp3064.esams.wmnet with OS buster |
[production] |
10:01 |
<vgutierrez> |
depool cp3064 to be reimaged as cache::text_haproxy - T290005 |
[production] |
09:52 |
<vgutierrez@cumin1001> |
END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2041.codfw.wmnet with OS buster |
[production] |
09:52 |
<vgutierrez> |
pool cp2041 with HAProxy as TLS terminator - T290005 |
[production] |
09:46 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:42 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:36 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:35 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:34 |
<moritzm> |
rolling restart of mediawiki canaries to pick up ICU security updates |
[production] |
09:34 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: NOOP: 3a892860b2e1e2ac7b60fc1c4dbdb2035d6af950: foundationwiki: Do not enable wmgUsePageViewInfo explicitly (duration: 00m 55s) |
[production] |
09:32 |
<urbanecm> |
[urbanecm@mwmaint1002 ~]$ mwscript emptyUserGroup.php --wiki=foundationwiki 'inactive' # removing nonexistent group; backup left at P17888 |
[production] |
09:30 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 786313c06188d5d63700d7e46384ef99a9297b57: foundationwiki: Clear group add/remove declarations (duration: 00m 55s) |
[production] |
09:29 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:28 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
09:27 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: c3f47dc55b67d2b53ec27bb610978ff8165aa6ca: foundationwiki: Disable hard redirects (duration: 00m 57s) |
[production] |
08:59 |
<vgutierrez@cumin1001> |
START - Cookbook sre.hosts.reimage for host cp2041.codfw.wmnet with OS buster |
[production] |
08:56 |
<vgutierrez> |
depool cp2041 to be reimaged as cache::text_haproxy - T290005 |
[production] |
08:54 |
<moritzm> |
installing ICU security updates on buster |
[production] |
08:33 |
<moritzm> |
installing bluez security updates |
[production] |
08:26 |
<moritzm> |
installing libvpx security updates |
[production] |
08:19 |
<moritzm> |
instaling libntlm security updates |
[production] |
08:07 |
<elukey@deploy1002> |
Finished deploy [ores/deploy@69ed061]: Upgrade of mwparserfromhell - T296563 (duration: 07m 01s) |
[production] |
08:00 |
<marostegui> |
Restart db2078 and db1117 |
[production] |
08:00 |
<elukey@deploy1002> |
Started deploy [ores/deploy@69ed061]: Upgrade of mwparserfromhell - T296563 |
[production] |