1051-1100 of 10000 results (36ms)
2021-11-29 ยง
16:20 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host elastic2069.codfw.wmnet with OS buster [production]
16:04 <moritzm> sudo gnt-cluster upgrade --to 2.16 for Ganeti codfw cluster [production]
15:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:52 <vgutierrez> depool cp3064 - T290005 [production]
15:51 <James_F> Running mwscript extensions/WikimediaMaintenance/addWiki.php --wiki=enwiki en wikimedia wikifunctionswiki wikifunctions.beta.wmflabs.org in Beta Cluster for T284162 [production]
15:51 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host elastic2069.codfw.wmnet with OS buster [production]
15:48 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:47 <papaul> power down logstash2028 for IDRAC reset [production]
15:47 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
15:15 <moritzm> gnt-cluster renew-crypto --new-cluster-certificate for codfw Ganeti cluster T296622 [production]
14:40 <mbsantos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
14:38 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
14:37 <mbsantos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
13:55 <vgutierrez> repool cp3064 - T290005 [production]
12:51 <moritzm> upgrading ganeti codfw cluster to 2.16 backport T296622 [production]
12:49 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:48 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:32 <vgutierrez> depool cp3064 - T290005 [production]
12:32 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/GrowthExperiments/includes/HomepageModules/SuggestedEdits.php: 05704407395fbf227eec47cf716393dc60a36a35: Fix error handling in SuggestedEdits::getActionData (T296366) (duration: 05m 37s) [production]
12:29 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:28 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:17 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:16 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:13 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: 7fdea3e71e4fd9e85c30efbc17f94c0711deb252: Add planet4589.org to the wgCopyUploadsDomains allowlist of Wikimedia Commons (T296136) (duration: 00m 56s) [production]
12:11 <vgutierrez> pool cp3064 (text) using HAProxy as TLS terminator - T290005 [production]
12:10 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:09 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp3064.esams.wmnet with OS buster [production]
12:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:07 <urbanecm@deploy1002> Synchronized docroot/: 4662224229cb4083b8b01de436ccd65e8c00e7dd: Remove search.wikimedia.org files (T289224) (duration: 00m 56s) [production]
11:02 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:01 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:58 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/CentralAuth/includes/CentralAuthUser.php: 5fc6aaa73202a1bf2aa58998d2671d5f4a6255bc: Fix "Mark entries as bot entries" feature(2/2; T296297) (duration: 00m 55s) [production]
10:57 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/CentralAuth/includes/Special/SpecialMultiLock.php: 5fc6aaa73202a1bf2aa58998d2671d5f4a6255bc: Fix "Mark entries as bot entries" feature (1/2; T296297) (duration: 00m 56s) [production]
10:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:54 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:52 <urbanecm@deploy1002> Synchronized wmf-config/InitialiseSettings.php: d01652ec22f6cb3413b419a3c9b0a7a08d79960f: Disable Growth IP research survey (T294568) (duration: 00m 56s) [production]
10:45 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reimage for host cp3064.esams.wmnet with OS buster [production]
10:45 <vgutierrez@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp3064.esams.wmnet with OS buster [production]
10:02 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reimage for host cp3064.esams.wmnet with OS buster [production]
10:01 <vgutierrez> depool cp3064 to be reimaged as cache::text_haproxy - T290005 [production]
09:52 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2041.codfw.wmnet with OS buster [production]
09:52 <vgutierrez> pool cp2041 with HAProxy as TLS terminator - T290005 [production]
09:46 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:42 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:36 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:35 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
09:34 <moritzm> rolling restart of mediawiki canaries to pick up ICU security updates [production]