251-300 of 10000 results (25ms)
2020-04-06 §
09:40 <marostegui> Deploy schema change on db1099:3311 [production]
09:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1099:3311 for schema change', diff saved to https://phabricator.wikimedia.org/P10898 and previous config saved to /var/cache/conftool/dbconfig/20200406-093944-marostegui.json [production]
09:11 <ema> cp2027: upgrade varnish to 5.1.3-1wm13 and restart varnish-fe T249344 [production]
09:08 <ema> upload varnish 5.1.3-1wm13 to buster-wikimedia on apt1001.wm.org T249344 [production]
08:55 <ariel@deploy1001> Finished deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link (duration: 00m 09s) [production]
08:55 <ariel@deploy1001> Started deploy [dumps/dumps@ae1e705]: add prefetch test, fix multistream index file download link [production]
08:54 <elukey> bootstrap wdqs200[7,8] - T246343 [production]
08:50 <marostegui> Deploy schema change on db1139:3311 [production]
08:18 <_joe_> conversion of codfw api done [production]
08:07 <marostegui> Deploy schema change on dbstore1003:3311 [production]
07:54 <vgutierrez> rolling restart of ats-tls to disable wmf-analytics log - T249335 T237993 [production]
07:50 <dcausse> search index: deleting stale index wikidatawiki_content_1585224806 on cloudelastic:9243 [production]
07:49 <_joe_> eqiad API migrated to envoy for local TLS termination, now starting codfw [production]
07:35 <elukey> restart elasticsearch_6@cloudelastic-chi-eqiad on cloudelastic1003 as attempt to fix heavy GC runs (old gen) - T231517 [production]
07:35 <marostegui> Rename wb_terms on eqiad excluding labsdb1009, labdb1010, labsdb1011 - T248086 [production]
07:06 <marostegui> Rename wb_terms on codfw - T248086 [production]
06:45 <XioNoX> delete BGP to AS25074 in amsix [production]
06:36 <_joe_> converting the api servers to envoy for TLS in eqiad [production]
06:30 <marostegui> Upgrade dbproxy1019 - T231520 [production]
06:18 <marostegui> Deploy schema change on s1 codfw master, this will generate lag on codfw [production]
05:54 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
05:54 <marostegui@cumin1001> START - Cookbook sre.hosts.decommission [production]
05:50 <vgutierrez> ats-tls restart in cp3056, cp3058 and cp3062 - T249335 [production]
05:45 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1079 after schema change', diff saved to https://phabricator.wikimedia.org/P10897 and previous config saved to /var/cache/conftool/dbconfig/20200406-054559-marostegui.json [production]
05:18 <marostegui> Deploy schema change on db1079 (this will generate lag on s7 labs) [production]
05:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1079 for schema change', diff saved to https://phabricator.wikimedia.org/P10896 and previous config saved to /var/cache/conftool/dbconfig/20200406-051744-marostegui.json [production]
05:16 <vgutierrez> Enable inbound TLSv1.3 in upload@eqiad - T170567 [production]
05:16 <vgutierrez> Enable TLS Session Tickets on eqiad - T245616 [production]
05:01 <vgutierrez> ats-tls restart in cp1075, cp1081 and cp1087 - T249335 [production]
2020-04-03 §
21:17 <andrewbogott> ugpraded wikitech-static to 1.34.1 [production]
17:58 <mutante> rsync home dirs from install1002 to apt1001:/srv/home_install1002... [production]
15:43 <ema> cp3061: restart varnish-fe T249344 [production]
15:30 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:19 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:18 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:18 <ema> cp3057: restart varnish-fe T249344 [production]
14:37 <hashar> Restarting Jenkins for a CSP parameter T245658 [production]
14:07 <vgutierrez> restart ats-tls on cp1087 - T249335 [production]
14:01 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1090:3317 after schema change', diff saved to https://phabricator.wikimedia.org/P10882 and previous config saved to /var/cache/conftool/dbconfig/20200403-140132-marostegui.json [production]
13:55 <vgutierrez> restart ats-tls on cp1075 and cp1081 - T249335 [production]
12:49 <marostegui> Deploy schema change on db1090:3317 [production]
12:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1090:3317 for schema change', diff saved to https://phabricator.wikimedia.org/P10881 and previous config saved to /var/cache/conftool/dbconfig/20200403-124908-marostegui.json [production]
12:48 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1136 after schema change', diff saved to https://phabricator.wikimedia.org/P10880 and previous config saved to /var/cache/conftool/dbconfig/20200403-124827-marostegui.json [production]
12:45 <dcausse@deploy1001> Finished deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs1007: testing T249196 (duration: 00m 43s) [production]
12:44 <dcausse@deploy1001> Started deploy [wdqs/wdqs@23495ae]: deploying wdqs 0.3.17 to wdqs1007: testing T249196 [production]
12:27 <marostegui> Deploy schema change on db1136 [production]
12:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1136 for schema change', diff saved to https://phabricator.wikimedia.org/P10879 and previous config saved to /var/cache/conftool/dbconfig/20200403-122716-marostegui.json [production]
12:23 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1094 after schema change', diff saved to https://phabricator.wikimedia.org/P10878 and previous config saved to /var/cache/conftool/dbconfig/20200403-122259-marostegui.json [production]
12:00 <marostegui> Deploy schema change on db1094 [production]
12:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1094 for schema change', diff saved to https://phabricator.wikimedia.org/P10877 and previous config saved to /var/cache/conftool/dbconfig/20200403-115959-marostegui.json [production]