|
2020-01-16
§
|
| 19:08 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@7bf9819]: (no justification provided) |
[production] |
| 19:08 |
<catrope@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Remove kask-echoseen-transition definition, now unused (T234963) (duration: 01m 35s) |
[production] |
| 19:05 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Echo: switch entirely to Kask, remove Redis fallback (T234963) (duration: 00m 56s) |
[production] |
| 19:02 |
<arlolra@deploy1001> |
Finished deploy [parsoid/deploy@7bf9819]: Updating Parsoid to 02f0066 (duration: 08m 30s) |
[production] |
| 18:54 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@7bf9819]: Updating Parsoid to 02f0066 |
[production] |
| 18:01 |
<urandom> |
bootstrapping restbase2021-a — T243000 |
[production] |
| 17:48 |
<James_F> |
Manually purged the trwiki logos from Varnish as part of updating them to reflect unblocking, T242977 |
[production] |
| 17:48 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki-2x.png: [trwiki] Change logo to reflect unblocking, 2x T242977 (duration: 00m 56s) |
[production] |
| 17:47 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki-1.5x.png: [trwiki] Change logo to reflect unblocking, 1.5x T242977 (duration: 00m 55s) |
[production] |
| 17:46 |
<jforrester@deploy1001> |
Synchronized static/images/project-logos/trwiki.png: [trwiki] Change logo to reflect unblocking, 1x T242977 (duration: 00m 56s) |
[production] |
| 17:39 |
<effie> |
Updgrade parsoid to to php 7.2.26 and restart - T241222 |
[production] |
| 17:05 |
<dcausse> |
restarting blazegraph@wdqs1007 (T242453) |
[production] |
| 17:02 |
<jakob@deploy1001> |
helmfile [EQIAD] Ran 'apply' command on namespace 'termbox' for release 'production' . |
[production] |
| 16:53 |
<jakob@deploy1001> |
helmfile [CODFW] Ran 'apply' command on namespace 'termbox' for release 'production' . |
[production] |
| 16:51 |
<jakob@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'staging' . |
[production] |
| 16:31 |
<dcausse> |
depooling wdqs1007, blazegraph stuck (T242453) |
[production] |
| 16:30 |
<jakob@deploy1001> |
helmfile [STAGING] Ran 'apply' command on namespace 'termbox' for release 'test' . |
[production] |
| 15:59 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:59 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:59 |
<effie> |
Updgrade appservers and api to php 7.2.26 and restart - T241222 |
[production] |
| 15:16 |
<elukey@deploy1001> |
Finished deploy [analytics/superset/deploy@16a1644]: Upgrade to superset 0.35.2 (duration: 00m 40s) |
[production] |
| 15:15 |
<elukey@deploy1001> |
Started deploy [analytics/superset/deploy@16a1644]: Upgrade to superset 0.35.2 |
[production] |
| 15:04 |
<vgutierrez> |
rolling restart of ats-tls. This effectively disables TLSv1/1.1 across the caching cluster - T238038 |
[production] |
| 14:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10182 and previous config saved to /var/cache/conftool/dbconfig/20200116-142800-marostegui.json |
[production] |
| 14:05 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10181 and previous config saved to /var/cache/conftool/dbconfig/20200116-140501-marostegui.json |
[production] |
| 14:04 |
<liw@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.15 |
[production] |
| 13:57 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10180 and previous config saved to /var/cache/conftool/dbconfig/20200116-135659-marostegui.json |
[production] |
| 13:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10179 and previous config saved to /var/cache/conftool/dbconfig/20200116-134801-marostegui.json |
[production] |
| 13:37 |
<marostegui> |
Upgrade db1097:3314 db1097:3315 |
[production] |
| 13:35 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1097:3314 db1097:3315', diff saved to https://phabricator.wikimedia.org/P10178 and previous config saved to /var/cache/conftool/dbconfig/20200116-133515-marostegui.json |
[production] |
| 13:30 |
<moritzm> |
restarting Swift frontends to pick up OpenSSL security update |
[production] |
| 13:09 |
<Urbanecm> |
EU SWAT done late |
[production] |
| 13:02 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: aedd2c4: Add HD logos to IS.php (duration: 01m 04s) |
[production] |
| 13:00 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 940b9a2: Add wgLogoHD entry for fa, te wikiquote & fr wikisource in IS.php (duration: 01m 05s) |
[production] |
| 12:54 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: Sync project logos (duration: 01m 06s) |
[production] |
| 12:51 |
<XioNoX> |
remove BGP sessions to AS22652 in eqiad (left the IX) |
[production] |
| 12:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Fully repool db1080', diff saved to https://phabricator.wikimedia.org/P10176 and previous config saved to /var/cache/conftool/dbconfig/20200116-124516-marostegui.json |
[production] |
| 12:42 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 7381446: Add `Tutoriel` namespace for French Wiktionary (T242102) (duration: 01m 04s) |
[production] |
| 12:40 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 12:38 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P10175 and previous config saved to /var/cache/conftool/dbconfig/20200116-123841-marostegui.json |
[production] |
| 12:38 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 12:33 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 65e17eb: Configure GlobalRename blacklist (T101615) (duration: 01m 05s) |
[production] |
| 12:30 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:565073|Stop writing to wb_terms for properties in Test Wikidata (T225054)]] (duration: 01m 05s) |
[production] |
| 12:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Slowly repool db1080', diff saved to https://phabricator.wikimedia.org/P10174 and previous config saved to /var/cache/conftool/dbconfig/20200116-122806-marostegui.json |
[production] |
| 12:23 |
<effie> |
restart php-fpm on labweb* |
[production] |
| 12:19 |
<Amir1> |
"delete from testwikidatawiki.wb_terms where term_full_entity_id like 'P%'" (T219301 T225054) |
[production] |
| 12:17 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Another sync for the IS.php cache issue (duration: 01m 04s) |
[production] |
| 12:16 |
<effie> |
Updgrade jobrunners to php 7.2.26 and restart - T241222 |
[production] |
| 12:15 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:565073|Stop writing to wb_terms for properties in Test Wikidata (T225054)]] (duration: 01m 04s) |
[production] |
| 12:14 |
<moritzm> |
installing OpenSSL security updates |
[production] |