651-700 of 10000 results (60ms)
2019-09-24 ยง
13:19 <volans@cumin1001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=True) [production]
13:18 <volans@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:02 <@> helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . [production]
12:22 <arturo> remove systemd-sysv from jessie-wikimedia/openstack-mitaka-jessie in install1002 (T231793) [production]
12:20 <dcausse@deploy1001> Synchronized wmf-config/CirrusSearch-production.php: T233584 [cirrus] temp disable sanity check (duration: 00m 55s) [production]
12:18 <mobrovac@deploy1001> Finished deploy [restbase/deploy@19d0f44]: REVERT (due to wikifeeds problems): Start using the wikifeeds service for v1/feed - T170455 (duration: 02m 35s) [production]
12:16 <mobrovac@deploy1001> Started deploy [restbase/deploy@19d0f44]: REVERT (due to wikifeeds problems): Start using the wikifeeds service for v1/feed - T170455 [production]
11:47 <mobrovac@deploy1001> Finished deploy [restbase/deploy@87eea26]: Start using the wikifeeds service for v1/feed - T170455 (duration: 02m 35s) [production]
11:45 <mobrovac@deploy1001> Started deploy [restbase/deploy@87eea26]: Start using the wikifeeds service for v1/feed - T170455 [production]
11:43 <Urbanecm> EU SWAT done [production]
11:41 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: 11a48f8: Add support for some languages on Commons and stop support for nys on Wikidata (T230480) (duration: 00m 56s) [production]
11:39 <Urbanecm> Run mwscript initSiteStats.php --wiki=napwikisource --update (T233673) [production]
11:37 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: 9eaa4f8: Set wgArticleCountMethod to any for napwikisource (T233673) (duration: 00m 56s) [production]
11:30 <Urbanecm> Purge https://en.wikipedia.org/static/images/project-logos/mxwikimedia.png (T233670) [production]
11:30 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: b6947c5: Follow-up 8f3f0705baed: add missing namespace for eswiki (T233562) (duration: 00m 56s) [production]
11:27 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/MassMessage/: SWAT: ba9b209: Provide deduplication info to MassMessageJob (T232379) (duration: 00m 57s) [production]
11:26 <urbanecm@deploy1001> Synchronized static/images/project-logos/mxwikimedia.png: SWAT: 246b352: Update logo for mx.wikimedia (T233670) (duration: 00m 54s) [production]
11:24 <urbanecm@deploy1001> Synchronized php-1.34.0-wmf.23/extensions/GrowthExperiments/modules/homepage/ext.growthExperiments.Homepage.less: SWAT: d4c64a7: Fix broken display of mobile overlay headings (T233163) (duration: 00m 57s) [production]
11:16 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: 8bf6aae: Enable alternate mobile link for ar,zh,hi wikis (T206497) (duration: 00m 54s) [production]
11:10 <_joe_> all wikis (including API) are now served by PHP7 T219150 [production]
11:09 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: a14b772: FileImporter: limited default deployment (2/2; T232539) (duration: 00m 56s) [production]
11:05 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: 8a89652: FileImporter: limited default deployment (1/2; T232539) (duration: 01m 03s) [production]
10:56 <mobrovac@deploy1001> Finished deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 (duration: 01m 00s) [production]
10:55 <mobrovac@deploy1001> Started deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 [production]
10:54 <_joe_> converting all appservers to php7, T219150 [production]
10:51 <mobrovac@deploy1001> Finished deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 (duration: 22m 20s) [production]
10:50 <_joe_> converting mw1261 to full-php7 [production]
10:29 <mobrovac@deploy1001> Started deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 [production]
10:12 <marostegui> Deploy schema change on s7 (centralauth and wikis) master with replication - T231172 [production]
10:03 <marostegui> Deploy schema change on s1 master with replication - T231172 [production]
09:58 <marostegui> Deploy schema change on labswiki (wikitech) and labtestwiki T231172 [production]
09:51 <effie> Upgrade to php 7.2.22 on mwmaint* - T230024 [production]
09:30 <marostegui> Deploy schema change on s2 master with replication - T231172 [production]
09:26 <effie> Upgrade to php 7.2.22 on deploy* - T230024 [production]
09:14 <marostegui> Drop table archive_save on frwiki T233187 [production]
08:43 <marostegui> Deploy schema change on s8 master with replication - T231172 [production]
08:37 <mvolz@deploy1001> scap-helm zotero finished [production]
08:37 <mvolz@deploy1001> scap-helm zotero cluster codfw completed [production]
08:37 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] [production]
08:36 <jynus> stop db1114 mariadb process for some time [production]
08:33 <moritzm> installed expat security updates on remaining mw* servers [production]
08:33 <mvolz@deploy1001> scap-helm zotero finished [production]
08:32 <mvolz@deploy1001> scap-helm zotero cluster eqiad completed [production]
08:32 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] [production]
08:30 <marostegui> Deploy schema change on s4 master with replication - T231172 [production]
08:29 <effie> Disable puppet on api cluster and restart php-fpm to finish php7 migration - T219150 [production]
08:19 <mvolz@deploy1001> scap-helm zotero finished [production]
08:19 <mvolz@deploy1001> scap-helm zotero cluster staging completed [production]
08:19 <mvolz@deploy1001> scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] [production]
08:18 <marostegui> Deploy schema change on s5 master with replication - T231172 [production]