|
2020-04-06
§
|
| 09:08 |
<ema> |
upload varnish 5.1.3-1wm13 to buster-wikimedia on apt1001.wm.org T249344 |
[production] |
| 08:55 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link (duration: 00m 09s) |
[production] |
| 08:55 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link |
[production] |
| 08:54 |
<elukey> |
bootstrap wdqs200[7,8] - T246343 |
[production] |
| 08:50 |
<marostegui> |
Deploy schema change on db1139:3311 |
[production] |
| 08:18 |
<_joe_> |
conversion of codfw api done |
[production] |
| 08:07 |
<marostegui> |
Deploy schema change on dbstore1003:3311 |
[production] |
| 07:54 |
<vgutierrez> |
rolling restart of ats-tls to disable wmf-analytics log - T249335 T237993 |
[production] |
| 07:50 |
<dcausse> |
search index: deleting stale index wikidatawiki_content_1585224806 on cloudelastic:9243 |
[production] |
| 07:49 |
<_joe_> |
eqiad API migrated to envoy for local TLS termination, now starting codfw |
[production] |
| 07:35 |
<elukey> |
restart elasticsearch_6@cloudelastic-chi-eqiad on cloudelastic1003 as attempt to fix heavy GC runs (old gen) - T231517 |
[production] |
| 07:35 |
<marostegui> |
Rename wb_terms on eqiad excluding labsdb1009, labdb1010, labsdb1011 - T248086 |
[production] |
| 07:06 |
<marostegui> |
Rename wb_terms on codfw - T248086 |
[production] |
| 06:45 |
<XioNoX> |
delete BGP to AS25074 in amsix |
[production] |
| 06:36 |
<_joe_> |
converting the api servers to envoy for TLS in eqiad |
[production] |
| 06:30 |
<marostegui> |
Upgrade dbproxy1019 - T231520 |
[production] |
| 06:18 |
<marostegui> |
Deploy schema change on s1 codfw master, this will generate lag on codfw |
[production] |
| 05:54 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) |
[production] |
| 05:54 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
| 05:50 |
<vgutierrez> |
ats-tls restart in cp3056, cp3058 and cp3062 - T249335 |
[production] |
| 05:45 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1079 after schema change', diff saved to https://phabricator.wikimedia.org/P10897 and previous config saved to /var/cache/conftool/dbconfig/20200406-054559-marostegui.json |
[production] |
| 05:18 |
<marostegui> |
Deploy schema change on db1079 (this will generate lag on s7 labs) |
[production] |
| 05:17 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1079 for schema change', diff saved to https://phabricator.wikimedia.org/P10896 and previous config saved to /var/cache/conftool/dbconfig/20200406-051744-marostegui.json |
[production] |
| 05:16 |
<vgutierrez> |
Enable inbound TLSv1.3 in upload@eqiad - T170567 |
[production] |
| 05:16 |
<vgutierrez> |
Enable TLS Session Tickets on eqiad - T245616 |
[production] |
| 05:01 |
<vgutierrez> |
ats-tls restart in cp1075, cp1081 and cp1087 - T249335 |
[production] |
|
2020-04-03
§
|
| 21:17 |
<andrewbogott> |
ugpraded wikitech-static to 1.34.1 |
[production] |
| 17:58 |
<mutante> |
rsync home dirs from install1002 to apt1001:/srv/home_install1002... |
[production] |
| 15:43 |
<ema> |
cp3061: restart varnish-fe T249344 |
[production] |
| 15:30 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 15:19 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 15:18 |
<hnowlan@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . |
[production] |
| 15:18 |
<ema> |
cp3057: restart varnish-fe T249344 |
[production] |
| 14:37 |
<hashar> |
Restarting Jenkins for a CSP parameter T245658 |
[production] |
| 14:07 |
<vgutierrez> |
restart ats-tls on cp1087 - T249335 |
[production] |
| 14:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1090:3317 after schema change', diff saved to https://phabricator.wikimedia.org/P10882 and previous config saved to /var/cache/conftool/dbconfig/20200403-140132-marostegui.json |
[production] |
| 13:55 |
<vgutierrez> |
restart ats-tls on cp1075 and cp1081 - T249335 |
[production] |
| 12:49 |
<marostegui> |
Deploy schema change on db1090:3317 |
[production] |
| 12:49 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1090:3317 for schema change', diff saved to https://phabricator.wikimedia.org/P10881 and previous config saved to /var/cache/conftool/dbconfig/20200403-124908-marostegui.json |
[production] |
| 12:48 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1136 after schema change', diff saved to https://phabricator.wikimedia.org/P10880 and previous config saved to /var/cache/conftool/dbconfig/20200403-124827-marostegui.json |
[production] |
| 12:45 |
<dcausse@deploy1001> |
Finished deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs1007: testing T249196 (duration: 00m 43s) |
[production] |
| 12:44 |
<dcausse@deploy1001> |
Started deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs1007: testing T249196 |
[production] |
| 12:27 |
<marostegui> |
Deploy schema change on db1136 |
[production] |
| 12:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1136 for schema change', diff saved to https://phabricator.wikimedia.org/P10879 and previous config saved to /var/cache/conftool/dbconfig/20200403-122716-marostegui.json |
[production] |
| 12:23 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1094 after schema change', diff saved to https://phabricator.wikimedia.org/P10878 and previous config saved to /var/cache/conftool/dbconfig/20200403-122259-marostegui.json |
[production] |
| 12:00 |
<marostegui> |
Deploy schema change on db1094 |
[production] |
| 12:00 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1094 for schema change', diff saved to https://phabricator.wikimedia.org/P10877 and previous config saved to /var/cache/conftool/dbconfig/20200403-115959-marostegui.json |
[production] |
| 11:59 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Repool db1098:3317 after schema change', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20200403-115854-marostegui.json |
[production] |
| 11:40 |
<marostegui> |
Deploy schema change on db1098:3317 |
[production] |
| 11:40 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1098:3317 for schema change', diff saved to https://phabricator.wikimedia.org/P10875 and previous config saved to /var/cache/conftool/dbconfig/20200403-114004-marostegui.json |
[production] |