2019-09-24
ยง
|
11:24 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/GrowthExperiments/modules/homepage/ext.growthExperiments.Homepage.less: SWAT: d4c64a7: Fix broken display of mobile overlay headings (T233163) (duration: 00m 57s) |
[production] |
11:16 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 8bf6aae: Enable alternate mobile link for ar,zh,hi wikis (T206497) (duration: 00m 54s) |
[production] |
11:10 |
<_joe_> |
all wikis (including API) are now served by PHP7 T219150 |
[production] |
11:09 |
<urbanecm@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: a14b772: FileImporter: limited default deployment (2/2; T232539) (duration: 00m 56s) |
[production] |
11:05 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 8a89652: FileImporter: limited default deployment (1/2; T232539) (duration: 01m 03s) |
[production] |
10:56 |
<mobrovac@deploy1001> |
Finished deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 (duration: 01m 00s) |
[production] |
10:55 |
<mobrovac@deploy1001> |
Started deploy [cpjobqueue/deploy@7857639]: Bump CirrusSearchLinksUpdate concurrency to clear the queue - T233584 |
[production] |
10:54 |
<_joe_> |
converting all appservers to php7, T219150 |
[production] |
10:51 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 (duration: 22m 20s) |
[production] |
10:50 |
<_joe_> |
converting mw1261 to full-php7 |
[production] |
10:29 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@19d0f44]: Expose the key_value buckets to production IPs - T223953 |
[production] |
10:12 |
<marostegui> |
Deploy schema change on s7 (centralauth and wikis) master with replication - T231172 |
[production] |
10:03 |
<marostegui> |
Deploy schema change on s1 master with replication - T231172 |
[production] |
09:58 |
<marostegui> |
Deploy schema change on labswiki (wikitech) and labtestwiki T231172 |
[production] |
09:51 |
<effie> |
Upgrade to php 7.2.22 on mwmaint* - T230024 |
[production] |
09:30 |
<marostegui> |
Deploy schema change on s2 master with replication - T231172 |
[production] |
09:26 |
<effie> |
Upgrade to php 7.2.22 on deploy* - T230024 |
[production] |
09:14 |
<marostegui> |
Drop table archive_save on frwiki T233187 |
[production] |
08:43 |
<marostegui> |
Deploy schema change on s8 master with replication - T231172 |
[production] |
08:37 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
08:37 |
<mvolz@deploy1001> |
scap-helm zotero cluster codfw completed |
[production] |
08:37 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] |
[production] |
08:36 |
<jynus> |
stop db1114 mariadb process for some time |
[production] |
08:33 |
<moritzm> |
installed expat security updates on remaining mw* servers |
[production] |
08:33 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
08:32 |
<mvolz@deploy1001> |
scap-helm zotero cluster eqiad completed |
[production] |
08:32 |
<mvolz@deploy1001> |
scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] |
[production] |
08:30 |
<marostegui> |
Deploy schema change on s4 master with replication - T231172 |
[production] |
08:29 |
<effie> |
Disable puppet on api cluster and restart php-fpm to finish php7 migration - T219150 |
[production] |
08:19 |
<mvolz@deploy1001> |
scap-helm zotero finished |
[production] |
08:19 |
<mvolz@deploy1001> |
scap-helm zotero cluster staging completed |
[production] |
08:19 |
<mvolz@deploy1001> |
scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] |
[production] |
08:18 |
<marostegui> |
Deploy schema change on s5 master with replication - T231172 |
[production] |
07:51 |
<onimisionipe> |
depool wdqs1006 to clear HTTP too many request error |
[production] |
07:43 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
07:42 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
07:38 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
07:38 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
07:33 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
07:32 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
07:29 |
<moritzm> |
uploaded openjdk-8 8u222-b10-1~deb10u2 to buster-wikimedia component/jdk8 T233604 |
[production] |
07:26 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
07:24 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
07:18 |
<godog> |
swift eqiad-prod: continue ms-be1027 decom T233289 |
[production] |
06:40 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
06:40 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
06:37 |
<marostegui> |
Stop MySQL on db1066 - T233071 |
[production] |
06:36 |
<marostegui> |
Remove db1066 from tendril and zarcillo T233071 |
[production] |
06:30 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1075', diff saved to https://phabricator.wikimedia.org/P9163 and previous config saved to /var/cache/conftool/dbconfig/20190924-063002-marostegui.json |
[production] |
06:19 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Give more weight to db1075', diff saved to https://phabricator.wikimedia.org/P9162 and previous config saved to /var/cache/conftool/dbconfig/20190924-061943-marostegui.json |
[production] |