7251-7300 of 10000 results (42ms)
2021-06-22 ยง
18:28 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thumbor1005.eqiad.wmnet with reason: REIMAGE [production]
18:27 <awight@deploy1002> sync-file aborted: Backport: [[gerrit:700734|Revert "Fall back from explicit parameter order to TemplateData sort" ()]] (duration: 00m 40s) [production]
18:26 <robh@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on thumbor1005.eqiad.wmnet with reason: REIMAGE [production]
18:19 <legoktm> pulled in updates for thirdparty/kubeadm-k8s-1-18 buster-wikimedia on apt1001 [production]
17:47 <brennen> gitlab1001: run ansible to deploy https://gerrit.wikimedia.org/r/700851 (T274463) [production]
17:42 <dduvall> testwikis to 1.37.0-wmf.11 (cc open blockers T285125 T285118 T271011) [production]
17:41 <dduvall@deploy1002> Finished scap: testwikis wikis to 1.37.0-wmf.11 (duration: 30m 59s) [production]
17:21 <moritzm> installing isc-dhcp security updates [production]
17:18 <mbsantos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:16 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . [production]
17:14 <mbsantos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . [production]
17:11 <moritzm> installing ruby-websocket-extensions security updates [production]
17:10 <dduvall@deploy1002> Started scap: testwikis wikis to 1.37.0-wmf.11 [production]
17:08 <mbsantos@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
17:07 <moritzm> installing velocity security updates [production]
17:07 <mbsantos@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . [production]
17:04 <dduvall> 1.37.0-wmf.11 was branched at c161d3bd063b06d09be4167b38a72087db3ba7d2 for T281152 [production]
17:04 <mbsantos@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . [production]
16:41 <Trey314159> reindexing Dutch wikis on elastic@eqiad, elastic@codfw, and cloudelastic (T284185) [production]
14:57 <dcausse@deploy1002> Finished deploy [wdqs/wdqs@b082ccc]: wdqs 0.3.74 (duration: 13m 26s) [production]
14:43 <dcausse@deploy1002> Started deploy [wdqs/wdqs@b082ccc]: wdqs 0.3.74 [production]
14:37 <XioNoX> start updating analytics firewall rules to capirca generated ones on cr2-eqiad - T279429 [production]
14:35 <hoo> Updated the Wikidata property suggester with data from the 2021-05-31 JSON dump (with pre-applied T132839 workarounds) [production]
14:01 <XioNoX> start updating analytics firewall rules to capirca generated ones on cr1-eqiad - T279429 [production]
13:49 <kormat> disabling puppet on A:db-all for T285079 [production]
13:38 <urbanecm> [urbanecm@mwmaint1002 /srv/mediawiki-staging/php]$ mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=nlwiki --phab=T285254 # T285254 [production]
13:37 <urbanecm> [urbanecm@mwmaint1002 /srv/mediawiki-staging]$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=nlwiki growthexperiments # T285254 [production]
13:33 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:700905|Correctly enable Vector language switcher treatment A/B test (T269093)]] (duration: 00m 57s) [production]
13:29 <urbanecm> urbanecm@mwmaint1002:~$ foreachwikiindblist growthexperiments extensions/WikimediaMaintenance/createExtensionTables.php growthexperiments # T266913 [production]
13:29 <Trey314159> reindexing German wikis on elastic@eqiad, elastic@codfw, and cloudelastic complete (T284185) [production]
12:04 <Lucas_WMDE> backport+config window done [production]
12:03 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:700705|Enable new Vector Languages-in-header feature & AB test for pilot wikis (T269093)]] (duration: 00m 56s) [production]
11:58 <Lucas_WMDE> lucaswerkmeister-wmde@mwdebug1001:~$ sudo -u mwdeploy sh -c 'rm /srv/mediawiki/php-1.37.0-wmf.1/cache/l10n/l10n_cache-*.cdb && rmdir /srv/mediawiki/php-1.37.0-wmf.1/cache/l10n && rmdir /srv/mediawiki/php-1.37.0-wmf.1/cache && rmdir /srv/mediawiki/php-1.37.0-wmf.1' # per comments in T157030 and similar tasks [production]
11:54 <lucaswerkmeister-wmde@deploy1002> Synchronized php-1.37.0-wmf.9/extensions/UniversalLanguageSelector/: Backport: [[gerrit:700730|launchULS: Add context to interface.language.change hook (T280770)]] (duration: 00m 57s) [production]
11:35 <moritzm> installing fluidsynth security updates [production]
11:17 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:698041|enwiki: Remove 'collectionsaveascommunitypage' from the 'autoconfirmed' user group (T283523)]] (duration: 00m 56s) [production]
11:06 <kormat@cumin1001> dbctl commit (dc=all): 'db1123 (re)pooling @ 100%: reimaged to buster T283131', diff saved to https://phabricator.wikimedia.org/P16691 and previous config saved to /var/cache/conftool/dbconfig/20210622-110619-kormat.json [production]
10:51 <kormat@cumin1001> dbctl commit (dc=all): 'db1123 (re)pooling @ 75%: reimaged to buster T283131', diff saved to https://phabricator.wikimedia.org/P16690 and previous config saved to /var/cache/conftool/dbconfig/20210622-105115-kormat.json [production]
10:36 <kormat@cumin1001> dbctl commit (dc=all): 'db1123 (re)pooling @ 50%: reimaged to buster T283131', diff saved to https://phabricator.wikimedia.org/P16689 and previous config saved to /var/cache/conftool/dbconfig/20210622-103612-kormat.json [production]
10:21 <kormat@cumin1001> dbctl commit (dc=all): 'db1123 (re)pooling @ 25%: reimaged to buster T283131', diff saved to https://phabricator.wikimedia.org/P16688 and previous config saved to /var/cache/conftool/dbconfig/20210622-102108-kormat.json [production]
09:40 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 100%: Repool db1166 after upgrade', diff saved to https://phabricator.wikimedia.org/P16687 and previous config saved to /var/cache/conftool/dbconfig/20210622-094019-root.json [production]
09:25 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 75%: Repool db1166 after upgrade', diff saved to https://phabricator.wikimedia.org/P16686 and previous config saved to /var/cache/conftool/dbconfig/20210622-092515-root.json [production]
09:20 <marostegui@cumin1001> dbctl commit (dc=all): 'db1169 (re)pooling @ 100%: Repool db1169 after schema change', diff saved to https://phabricator.wikimedia.org/P16685 and previous config saved to /var/cache/conftool/dbconfig/20210622-092056-root.json [production]
09:10 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 50%: Repool db1166 after upgrade', diff saved to https://phabricator.wikimedia.org/P16684 and previous config saved to /var/cache/conftool/dbconfig/20210622-091012-root.json [production]
09:05 <marostegui@cumin1001> dbctl commit (dc=all): 'db1169 (re)pooling @ 75%: Repool db1169 after schema change', diff saved to https://phabricator.wikimedia.org/P16683 and previous config saved to /var/cache/conftool/dbconfig/20210622-090552-root.json [production]
08:55 <marostegui@cumin1001> dbctl commit (dc=all): 'db1166 (re)pooling @ 25%: Repool db1166 after upgrade', diff saved to https://phabricator.wikimedia.org/P16682 and previous config saved to /var/cache/conftool/dbconfig/20210622-085508-root.json [production]
08:50 <marostegui@cumin1001> dbctl commit (dc=all): 'db1169 (re)pooling @ 50%: Repool db1169 after schema change', diff saved to https://phabricator.wikimedia.org/P16681 and previous config saved to /var/cache/conftool/dbconfig/20210622-085049-root.json [production]
08:49 <marostegui> Upgrade db1166 [production]
08:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1166', diff saved to https://phabricator.wikimedia.org/P16680 and previous config saved to /var/cache/conftool/dbconfig/20210622-084915-marostegui.json [production]
08:35 <marostegui@cumin1001> dbctl commit (dc=all): 'db1169 (re)pooling @ 25%: Repool db1169 after schema change', diff saved to https://phabricator.wikimedia.org/P16679 and previous config saved to /var/cache/conftool/dbconfig/20210622-083545-root.json [production]