|
2018-06-04
ยง
|
| 20:31 |
<awight@deploy1001> |
Started deploy [ores/deploy@d77e52c]: ores2001 canary of drafttopic; T176336 |
[production] |
| 20:30 |
<andrew@deploy1001> |
Finished deploy [horizon/deploy@12aa2d3]: fix for T192179 (duration: 03m 35s) |
[production] |
| 20:27 |
<andrew@deploy1001> |
Started deploy [horizon/deploy@12aa2d3]: fix for T192179 |
[production] |
| 20:23 |
<arlolra@deploy1001> |
Started deploy [parsoid/deploy@828034c]: Updating Parsoid to bd5a840 |
[production] |
| 19:10 |
<gehel> |
elasticsearch cluster restart on eqiad completed - T193734 |
[production] |
| 19:06 |
<ottomata> |
bouncing kafka2003 one more time for T196077 |
[production] |
| 19:04 |
<otto@deploy1001> |
Started restart [eventlogging/eventbus@3a5c395]: bouncing eventbus after upgrading to python-kafka 1.4.3 for T196077 |
[production] |
| 19:00 |
<ottomata> |
bouncing kafka2003 again to test T196077 with python-kafka 1.4.3 |
[production] |
| 18:52 |
<thcipriani@deploy1001> |
Synchronized docroot/noc/index.html: SWAT: [[gerrit:430879|Fix wrong link to Server Admin Log on noc.wikimedia.org]] T193848 (duration: 00m 50s) |
[production] |
| 18:44 |
<ottomata> |
bouncing kafka on kafka2003 to test T196077 |
[production] |
| 18:36 |
<otto@deploy1001> |
Finished deploy [eventlogging/eventbus@3a5c395]: T196077 (duration: 04m 07s) |
[production] |
| 18:35 |
<ottomata> |
deploying eventlogging-service-eventbus for T196077 |
[production] |
| 18:32 |
<otto@deploy1001> |
Started deploy [eventlogging/eventbus@3a5c395]: T196077 |
[production] |
| 18:31 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Redeploy to test (duration: 00m 25s) |
[production] |
| 18:30 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Redeploy to test |
[production] |
| 18:01 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Enable osm source (duration: 00m 25s) |
[production] |
| 18:00 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Enable osm source |
[production] |
| 17:56 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Enable osm-intl source (duration: 00m 25s) |
[production] |
| 17:55 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Enable osm-intl source |
[production] |
| 17:53 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Enable osm-pbf source (duration: 00m 25s) |
[production] |
| 17:52 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Enable osm-pbf source |
[production] |
| 17:51 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view (duration: 00m 25s) |
[production] |
| 17:51 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view |
[production] |
| 17:48 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view (duration: 00m 24s) |
[production] |
| 17:47 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view |
[production] |
| 17:44 |
<tgr> |
disabled SUL+wikitech 2FA for MarkAHershberger (T196370) |
[production] |
| 17:37 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view (duration: 00m 26s) |
[production] |
| 17:37 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Disable configurations after v3view |
[production] |
| 17:30 |
<gehel@deploy1001> |
Finished deploy [wdqs/wdqs@fd534fa]: WDQS: new GUI and blazegraph versions (duration: 08m 25s) |
[production] |
| 17:30 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test (duration: 02m 54s) |
[production] |
| 17:27 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test |
[production] |
| 17:22 |
<gehel@deploy1001> |
Started deploy [wdqs/wdqs@fd534fa]: WDQS: new GUI and blazegraph versions |
[production] |
| 17:22 |
<pnorman@deploy1001> |
Finished deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test (duration: 03m 24s) |
[production] |
| 17:18 |
<pnorman@deploy1001> |
Started deploy [tilerator/deploy@074d01a] (cleartables): Deploy new meddo to test |
[production] |
| 15:09 |
<_joe_> |
performing rolling restart of authdns servers to pick up ip change for the videoscalers |
[production] |
| 15:05 |
<herron> |
gzipped large rotated log files in analytics1003:/var/log/hive to clear icinga disk space warning |
[production] |
| 14:49 |
<_joe_> |
restarting low-traffic pybals in eqiad,codfw for adding the videoscaler VIP |
[production] |
| 14:38 |
<ppchelko@deploy1001> |
Started restart [cpjobqueue/deploy@c6dc83d]: (no justification provided) |
[production] |
| 14:35 |
<Amir1> |
ladsgroup@terbium:~$ foreachwikiindblist large deleteAutoPatrolLogs.php --sleep 2 --check-old |
[production] |
| 14:34 |
<marostegui> |
Reload haproxy on dbproxy1010 to repool labsdb1010 - T190704 |
[production] |
| 14:34 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool all sanitariums masters - T190704 (duration: 00m 49s) |
[production] |
| 14:28 |
<moritzm> |
installing wireshark security updates |
[production] |
| 14:27 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=true; selector: dnsdisc=videoscaler,name=eqiad |
[production] |
| 14:21 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: cluster=videoscaler,service=nginx,dc=codfw,name=mw211.* |
[production] |
| 14:21 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes:weight=10; selector: cluster=videoscaler,service=nginx,dc=codfw |
[production] |
| 14:20 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=.*,service=mathoid,cluster=kubernetes,name=.* |
[production] |
| 14:19 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes; selector: cluster=videoscaler,service=nginx,dc=eqiad |
[production] |
| 14:10 |
<herron> |
lithium:~# systemctl restart rsyslog.service |
[production] |
| 14:09 |
<marostegui> |
Stop replication on all sanitarium masters to move labsdb1010 to another sanitarium host - T190704 |
[production] |
| 14:05 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool all sanitariums masters - T190704 (duration: 00m 49s) |
[production] |