2020-04-06
§
|
11:18 |
<elukey> |
import AMD ROCm 3.3 packages in buster-wikimedia (component thirdparty/rocm33) - T247082 |
[production] |
11:17 |
<awight@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:580394|cirrus: Increase commonswiki near match weight (T245642)]] (duration: 00m 59s) |
[production] |
11:11 |
<awight@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:585779| Whitelist X-Wikimedia-Debug header for cross-wiki API requests (T249107)]] (duration: 00m 59s) |
[production] |
10:51 |
<jdrewniak@deploy1001> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 00m 58s) |
[production] |
10:50 |
<jdrewniak@deploy1001> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:586305| Bumping portals to master (563985)]] (duration: 01m 12s) |
[production] |
09:50 |
<XioNoX> |
push pfw firewall policies - T249267 |
[production] |
09:40 |
<marostegui> |
Deploy schema change on db1099:3311 |
[production] |
09:39 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1099:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10898 and previous config saved to /var/cache/conftool/dbconfig/20200406-093944-marostegui.json |
[production] |
09:11 |
<ema> |
cp2027: upgrade varnish to 5.1.3-1wm13 and restart varnish-fe T249344 |
[production] |
09:08 |
<ema> |
upload varnish 5.1.3-1wm13 to buster-wikimedia on apt1001.wm.org T249344 |
[production] |
08:55 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link (duration: 00m 09s) |
[production] |
08:55 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link |
[production] |
08:54 |
<elukey> |
bootstrap wdqs200[7,8] - T246343 |
[production] |
08:50 |
<marostegui> |
Deploy schema change on db1139:3311 |
[production] |
08:18 |
<_joe_> |
conversion of codfw api done |
[production] |
08:07 |
<marostegui> |
Deploy schema change on dbstore1003:3311 |
[production] |
07:54 |
<vgutierrez> |
rolling restart of ats-tls to disable wmf-analytics log - T249335 T237993 |
[production] |
07:50 |
<dcausse> |
search index: deleting stale index wikidatawiki_content_1585224806 on cloudelastic:9243 |
[production] |
07:49 |
<_joe_> |
eqiad API migrated to envoy for local TLS termination, now starting codfw |
[production] |
07:35 |
<elukey> |
restart elasticsearch_6@cloudelastic-chi-eqiad on cloudelastic1003 as attempt to fix heavy GC runs (old gen) - T231517 |
[production] |
07:35 |
<marostegui> |
Rename wb_terms on eqiad excluding labsdb1009, labdb1010, labsdb1011 - T248086 |
[production] |
07:06 |
<marostegui> |
Rename wb_terms on codfw - T248086 |
[production] |
06:45 |
<XioNoX> |
delete BGP to AS25074 in amsix |
[production] |
06:36 |
<_joe_> |
converting the api servers to envoy for TLS in eqiad |
[production] |
06:30 |
<marostegui> |
Upgrade dbproxy1019 - T231520 |
[production] |
06:18 |
<marostegui> |
Deploy schema change on s1 codfw master, this will generate lag on codfw |
[production] |
05:54 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
05:54 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
05:50 |
<vgutierrez> |
ats-tls restart in cp3056, cp3058 and cp3062 - T249335 |
[production] |
05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1079 after schema change', diff saved to https://phabricator.wikimedia.org/P10897 and previous config saved to /var/cache/conftool/dbconfig/20200406-054559-marostegui.json |
[production] |
05:18 |
<marostegui> |
Deploy schema change on db1079 (this will generate lag on s7 labs) |
[production] |
05:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1079 for schema change', diff saved to https://phabricator.wikimedia.org/P10896 and previous config saved to /var/cache/conftool/dbconfig/20200406-051744-marostegui.json |
[production] |
05:16 |
<vgutierrez> |
Enable inbound TLSv1.3 in upload@eqiad - T170567 |
[production] |
05:16 |
<vgutierrez> |
Enable TLS Session Tickets on eqiad - T245616 |
[production] |
05:01 |
<vgutierrez> |
ats-tls restart in cp1075, cp1081 and cp1087 - T249335 |
[production] |
2020-04-03
§
|
21:17 |
<andrewbogott> |
ugpraded wikitech-static to 1.34.1 |
[production] |
17:58 |
<mutante> |
rsync home dirs from install1002 to apt1001:/srv/home_install1002... |
[production] |
15:43 |
<ema> |
cp3061: restart varnish-fe T249344 |
[production] |
15:30 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
15:19 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
15:18 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
15:18 |
<ema> |
cp3057: restart varnish-fe T249344 |
[production] |
14:37 |
<hashar> |
Restarting Jenkins for a CSP parameter T245658 |
[production] |
14:07 |
<vgutierrez> |
restart ats-tls on cp1087 - T249335 |
[production] |
14:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1090:3317 after schema change', diff saved to https://phabricator.wikimedia.org/P10882 and previous config saved to /var/cache/conftool/dbconfig/20200403-140132-marostegui.json |
[production] |
13:55 |
<vgutierrez> |
restart ats-tls on cp1075 and cp1081 - T249335 |
[production] |
12:49 |
<marostegui> |
Deploy schema change on db1090:3317 |
[production] |
12:49 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1090:3317 for schema change', diff saved to https://phabricator.wikimedia.org/P10881 and previous config saved to /var/cache/conftool/dbconfig/20200403-124908-marostegui.json |
[production] |
12:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1136 after schema change', diff saved to https://phabricator.wikimedia.org/P10880 and previous config saved to /var/cache/conftool/dbconfig/20200403-124827-marostegui.json |
[production] |
12:45 |
<dcausse@deploy1001> |
Finished deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs1007: testing T249196 (duration: 00m 43s) |
[production] |