|
2021-06-22
ยง
|
| 20:19 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on an-web1001.eqiad.wmnet with reason: REIMAGE |
[production] |
| 20:12 |
<Trey314159> |
reindexing Portuguese wikis on elastic@eqiad, elastic@codfw, and cloudelastic (T284185) |
[production] |
| 20:12 |
<Trey314159> |
reindexing Dutch wikis on elastic@eqiad, elastic@codfw, and cloudelastic complete (T284185) |
[production] |
| 19:58 |
<brennen> |
gitlab1001: run ansible to deploy https://gerrit.wikimedia.org/r/c/operations/gitlab-ansible/+/699812 (T264231) |
[production] |
| 19:26 |
<legoktm> |
set mediawiki-l message acceptance to discard non-member posts instead of reject |
[production] |
| 19:09 |
<dduvall@deploy1002> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.37.0-wmf.11 |
[production] |
| 19:06 |
<dduvall> |
preparing to promote wmf.11 group0 (T281152) cc'ing risking patch contacts Amir1, Krinkle, DannyS712 |
[production] |
| 19:01 |
<dduvall@deploy1002> |
Pruned MediaWiki: 1.37.0-wmf.6 (duration: 03m 35s) |
[production] |
| 18:46 |
<ebernhardson@deploy1002> |
Finished deploy [wikimedia/discovery/analytics@75d35b4]: revert expect eventgate canary events in all dcs (duration: 04m 23s) |
[production] |
| 18:42 |
<ebernhardson@deploy1002> |
Started deploy [wikimedia/discovery/analytics@75d35b4]: revert expect eventgate canary events in all dcs |
[production] |
| 18:31 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thumbor1006.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:30 |
<awight@deploy1002> |
Synchronized php-1.37.0-wmf.11/extensions/VisualEditor: Backport: [[gerrit:700734|Revert "Fall back from explicit parameter order to TemplateData sort" ()]] (duration: 01m 09s) |
[production] |
| 18:28 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thumbor1006.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:28 |
<robh@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thumbor1005.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:27 |
<awight@deploy1002> |
sync-file aborted: Backport: [[gerrit:700734|Revert "Fall back from explicit parameter order to TemplateData sort" ()]] (duration: 00m 40s) |
[production] |
| 18:26 |
<robh@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on thumbor1005.eqiad.wmnet with reason: REIMAGE |
[production] |
| 18:19 |
<legoktm> |
pulled in updates for thirdparty/kubeadm-k8s-1-18 buster-wikimedia on apt1001 |
[production] |
| 17:47 |
<brennen> |
gitlab1001: run ansible to deploy https://gerrit.wikimedia.org/r/700851 (T274463) |
[production] |
| 17:42 |
<dduvall> |
testwikis to 1.37.0-wmf.11 (cc open blockers T285125 T285118 T271011) |
[production] |
| 17:41 |
<dduvall@deploy1002> |
Finished scap: testwikis wikis to 1.37.0-wmf.11 (duration: 30m 59s) |
[production] |
| 17:21 |
<moritzm> |
installing isc-dhcp security updates |
[production] |
| 17:18 |
<mbsantos@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 17:16 |
<mbsantos@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 17:14 |
<mbsantos@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 17:11 |
<moritzm> |
installing ruby-websocket-extensions security updates |
[production] |
| 17:10 |
<dduvall@deploy1002> |
Started scap: testwikis wikis to 1.37.0-wmf.11 |
[production] |
| 17:08 |
<mbsantos@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 17:07 |
<moritzm> |
installing velocity security updates |
[production] |
| 17:07 |
<mbsantos@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'wikifeeds' for release 'production' . |
[production] |
| 17:04 |
<dduvall> |
1.37.0-wmf.11 was branched at c161d3bd063b06d09be4167b38a72087db3ba7d2 for T281152 |
[production] |
| 17:04 |
<mbsantos@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'wikifeeds' for release 'staging' . |
[production] |
| 16:41 |
<Trey314159> |
reindexing Dutch wikis on elastic@eqiad, elastic@codfw, and cloudelastic (T284185) |
[production] |
| 14:57 |
<dcausse@deploy1002> |
Finished deploy [wdqs/wdqs@b082ccc]: wdqs 0.3.74 (duration: 13m 26s) |
[production] |
| 14:43 |
<dcausse@deploy1002> |
Started deploy [wdqs/wdqs@b082ccc]: wdqs 0.3.74 |
[production] |
| 14:37 |
<XioNoX> |
start updating analytics firewall rules to capirca generated ones on cr2-eqiad - T279429 |
[production] |
| 14:35 |
<hoo> |
Updated the Wikidata property suggester with data from the 2021-05-31 JSON dump (with pre-applied T132839 workarounds) |
[production] |
| 14:01 |
<XioNoX> |
start updating analytics firewall rules to capirca generated ones on cr1-eqiad - T279429 |
[production] |
| 13:49 |
<kormat> |
disabling puppet on A:db-all for T285079 |
[production] |
| 13:38 |
<urbanecm> |
[urbanecm@mwmaint1002 /srv/mediawiki-staging/php]$ mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=nlwiki --phab=T285254 # T285254 |
[production] |
| 13:37 |
<urbanecm> |
[urbanecm@mwmaint1002 /srv/mediawiki-staging]$ mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=nlwiki growthexperiments # T285254 |
[production] |
| 13:33 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:700905|Correctly enable Vector language switcher treatment A/B test (T269093)]] (duration: 00m 57s) |
[production] |
| 13:29 |
<urbanecm> |
urbanecm@mwmaint1002:~$ foreachwikiindblist growthexperiments extensions/WikimediaMaintenance/createExtensionTables.php growthexperiments # T266913 |
[production] |
| 13:29 |
<Trey314159> |
reindexing German wikis on elastic@eqiad, elastic@codfw, and cloudelastic complete (T284185) |
[production] |
| 12:04 |
<Lucas_WMDE> |
backport+config window done |
[production] |
| 12:03 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:700705|Enable new Vector Languages-in-header feature & AB test for pilot wikis (T269093)]] (duration: 00m 56s) |
[production] |
| 11:58 |
<Lucas_WMDE> |
lucaswerkmeister-wmde@mwdebug1001:~$ sudo -u mwdeploy sh -c 'rm /srv/mediawiki/php-1.37.0-wmf.1/cache/l10n/l10n_cache-*.cdb && rmdir /srv/mediawiki/php-1.37.0-wmf.1/cache/l10n && rmdir /srv/mediawiki/php-1.37.0-wmf.1/cache && rmdir /srv/mediawiki/php-1.37.0-wmf.1' # per comments in T157030 and similar tasks |
[production] |
| 11:54 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized php-1.37.0-wmf.9/extensions/UniversalLanguageSelector/: Backport: [[gerrit:700730|launchULS: Add context to interface.language.change hook (T280770)]] (duration: 00m 57s) |
[production] |
| 11:35 |
<moritzm> |
installing fluidsynth security updates |
[production] |
| 11:17 |
<lucaswerkmeister-wmde@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:698041|enwiki: Remove 'collectionsaveascommunitypage' from the 'autoconfirmed' user group (T283523)]] (duration: 00m 56s) |
[production] |
| 11:06 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'db1123 (re)pooling @ 100%: reimaged to buster T283131', diff saved to https://phabricator.wikimedia.org/P16691 and previous config saved to /var/cache/conftool/dbconfig/20210622-110619-kormat.json |
[production] |