5751-5800 of 10000 results (75ms)
2020-01-21 §
05:52 <marostegui> Remove partitions from db2091:3314 - T239453 [production]
05:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2091:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10231 and previous config saved to /var/cache/conftool/dbconfig/20200121-055149-marostegui.json [production]
05:50 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2084:3314 T239453', diff saved to https://phabricator.wikimedia.org/P10230 and previous config saved to /var/cache/conftool/dbconfig/20200121-055023-marostegui.json [production]
2020-01-20 §
16:14 <Urbanecm> Change email assigned to User:Sadsadas (T243222) [production]
15:28 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@2a1f493]: Update mobileapps to 1848cf5 (duration: 05m 55s) [production]
15:22 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@2a1f493]: Update mobileapps to 1848cf5 [production]
15:20 <vgutierrez> rolling upgrade of ats to version 8.0.5-1wm12 - T242620 T242778 [production]
15:03 <vgutierrez> uploaded trafficserver 8.0.5-1wm12 to apt.wm.o (stretch) - T242620 T242778 [production]
13:06 <jbond42_> add SSL validation to conftool/etcd expected no-op (https://gerrit.wikimedia.org/r/c/operations/puppet/+/566009) [production]
12:45 <vgutierrez> uploaded varnishkafka 1.0.14-1 to apt.wm.o (buster) - T242093 [production]
12:25 <elukey@cumin1001> END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) [production]
12:18 <elukey@cumin1001> START - Cookbook sre.zookeeper.roll-restart-zookeeper [production]
12:09 <moritzm> removing actinium in Ganeti T224551 [production]
12:08 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
12:07 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
11:43 <moritzm> removing alsafi in Ganeti T224551 [production]
11:41 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
11:40 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
11:32 <jbond42_> reverting untill joes change is finished - add SSL validation to conftool/etcd expected no-op (https://gerrit.wikimedia.org/r/c/operations/puppet/+/561817) [production]
11:30 <jbond42_> add SSL validation to conftool/etcd expected no-op (https://gerrit.wikimedia.org/r/c/operations/puppet/+/561817) [production]
11:14 <vgutierrez> deploying wikiworkshop TLS certificate on the text cluster - T242374 [production]
10:06 <moritzm> removing alcyone/aluminium in Ganeti T224551 [production]
10:06 <moritzm> removing alcyone/aluminium in Ganeti [production]
10:04 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
10:04 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
10:01 <jmm@cumin2001> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) [production]
10:01 <jmm@cumin2001> START - Cookbook sre.hosts.decommission [production]
09:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1129', diff saved to https://phabricator.wikimedia.org/P10225 and previous config saved to /var/cache/conftool/dbconfig/20200120-094445-marostegui.json [production]
09:36 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1129', diff saved to https://phabricator.wikimedia.org/P10224 and previous config saved to /var/cache/conftool/dbconfig/20200120-093603-marostegui.json [production]
09:26 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1129', diff saved to https://phabricator.wikimedia.org/P10223 and previous config saved to /var/cache/conftool/dbconfig/20200120-092642-marostegui.json [production]
09:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1129', diff saved to https://phabricator.wikimedia.org/P10222 and previous config saved to /var/cache/conftool/dbconfig/20200120-091929-marostegui.json [production]
09:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Fully repool db1094', diff saved to https://phabricator.wikimedia.org/P10221 and previous config saved to /var/cache/conftool/dbconfig/20200120-090850-marostegui.json [production]
09:06 <marostegui> Upgrade db1129 [production]
09:06 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1129', diff saved to https://phabricator.wikimedia.org/P10220 and previous config saved to /var/cache/conftool/dbconfig/20200120-090617-marostegui.json [production]
09:05 <moritzm> restarting CAS to pick up Java security updates [production]
09:03 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1094', diff saved to https://phabricator.wikimedia.org/P10219 and previous config saved to /var/cache/conftool/dbconfig/20200120-090336-marostegui.json [production]
09:01 <moritzm> installing Java security updates on an-conf* [production]
08:55 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1094', diff saved to https://phabricator.wikimedia.org/P10218 and previous config saved to /var/cache/conftool/dbconfig/20200120-085537-marostegui.json [production]
08:51 <marostegui> Upgrade db1139:3311 db1139:3316 [production]
08:49 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1094', diff saved to https://phabricator.wikimedia.org/P10217 and previous config saved to /var/cache/conftool/dbconfig/20200120-084908-marostegui.json [production]
08:44 <marostegui> Upgrade db1094 [production]
08:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1094', diff saved to https://phabricator.wikimedia.org/P10216 and previous config saved to /var/cache/conftool/dbconfig/20200120-084408-marostegui.json [production]
08:10 <marostegui> Compare data on db2085:3318 - T243148 [production]
08:07 <ema> powercycle cp3061 T238305 [production]
07:15 <marostegui> Remove partitions from revision on db2084:3314 T239453 [production]
07:15 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2084 T239453', diff saved to https://phabricator.wikimedia.org/P10215 and previous config saved to /var/cache/conftool/dbconfig/20200120-071513-marostegui.json [production]
07:10 <marostegui> Stop MySQL on es2020 to clone es2021 - T243052 [production]
06:09 <marostegui> Stop replication on db1107 [production]
06:08 <marostegui> Compress db1121 - T232446 [production]
06:08 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1121, pool db1084 into vslow T232446', diff saved to https://phabricator.wikimedia.org/P10214 and previous config saved to /var/cache/conftool/dbconfig/20200120-060759-marostegui.json [production]