51-100 of 10000 results (51ms)
2019-09-24 ยง
11:09 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: a14b772: FileImporter: limited default deployment (2/2; T232539) (duration: 00m 56s) [production]
11:05 <urbanecm@deploy1001> Synchronized wmf-config/VariantSettings.php: SWAT: 8a89652: FileImporter: limited default deployment (1/2; T232539) (duration: 01m 03s) [production]
10:56 <mobrovac@deploy1001> Finished deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 (duration: 01m 00s) [production]
10:55 <mobrovac@deploy1001> Started deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 [production]
10:54 <_joe_> converting all appservers to php7, T219150 [production]
10:51 <mobrovac@deploy1001> Finished deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 (duration: 22m 20s) [production]
10:50 <_joe_> converting mw1261 to full-php7 [production]
10:29 <mobrovac@deploy1001> Started deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 [production]
10:12 <marostegui> Deploy schema change on s7 (centralauth and wikis) master with replication - T231172 [production]
10:03 <marostegui> Deploy schema change on s1 master with replication - T231172 [production]
09:58 <marostegui> Deploy schema change on labswiki (wikitech) and labtestwiki T231172 [production]
09:51 <effie> Upgrade to php 7.2.22 on mwmaint* - T230024 [production]
09:30 <marostegui> Deploy schema change on s2 master with replication - T231172 [production]
09:26 <effie> Upgrade to php 7.2.22 on deploy* - T230024 [production]
09:14 <marostegui> Drop table archive_save on frwiki T233187 [production]
08:43 <marostegui> Deploy schema change on s8 master with replication - T231172 [production]
08:37 <mvolz@deploy1001> scap-helm zotero finished [production]
08:37 <mvolz@deploy1001> scap-helm zotero cluster codfw completed [production]
08:37 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] [production]
08:36 <jynus> stop db1114 mariadb process for some time [production]
08:33 <moritzm> installed expat security updates on remaining mw* servers [production]
08:33 <mvolz@deploy1001> scap-helm zotero finished [production]
08:32 <mvolz@deploy1001> scap-helm zotero cluster eqiad completed [production]
08:32 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] [production]
08:30 <marostegui> Deploy schema change on s4 master with replication - T231172 [production]
08:29 <effie> Disable puppet on api cluster and restart php-fpm to finish php7 migration - T219150 [production]
08:19 <mvolz@deploy1001> scap-helm zotero finished [production]
08:19 <mvolz@deploy1001> scap-helm zotero cluster staging completed [production]
08:19 <mvolz@deploy1001> scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] [production]
08:18 <marostegui> Deploy schema change on s5 master with replication - T231172 [production]
07:51 <onimisionipe> depool wdqs1006 to clear HTTP too many request error [production]
07:43 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
07:42 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:38 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:38 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
07:33 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
07:32 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
07:29 <moritzm> uploaded openjdk-8 8u222-b10-1~deb10u2 to buster-wikimedia component/jdk8 T233604 [production]
07:26 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
07:24 <elukey@cumin1001> START - Cookbook sre.hosts.downtime [production]
07:18 <godog> swift eqiad-prod: continue ms-be1027 decom T233289 [production]
06:40 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) [production]
06:40 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
06:37 <marostegui> Stop MySQL on db1066 - T233071 [production]
06:36 <marostegui> Remove db1066 from tendril and zarcillo T233071 [production]
06:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1075', diff saved to https://phabricator.wikimedia.org/P9163 and previous config saved to /var/cache/conftool/dbconfig/20190924-063002-marostegui.json [production]
06:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more weight to db1075', diff saved to https://phabricator.wikimedia.org/P9162 and previous config saved to /var/cache/conftool/dbconfig/20190924-061943-marostegui.json [production]
05:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Give more weight to db1075', diff saved to https://phabricator.wikimedia.org/P9161 and previous config saved to /var/cache/conftool/dbconfig/20190924-053919-marostegui.json [production]
05:25 <marostegui@cumin1001> dbctl commit (dc=all): 'Give weight 100 to db1075', diff saved to https://phabricator.wikimedia.org/P9160 and previous config saved to /var/cache/conftool/dbconfig/20190924-052545-marostegui.json [production]
05:13 <cdanis@cumin1001> dbctl commit (dc=all): 're-do T230783 master promotion and set read-write', diff saved to https://phabricator.wikimedia.org/P9159 and previous config saved to /var/cache/conftool/dbconfig/20190924-051307-cdanis.json [production]