451-500 of 10000 results (56ms)
2019-01-21 §
09:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Give more traffic to db1089 (duration: 00m 45s) [production]
09:42 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly Repool db1089 T210478 (duration: 00m 45s) [production]
09:30 <marostegui> Compress a few tables on dbstore1003:3315 - T210478 [production]
08:35 <marostegui> Stop replication db1077 to deploy schema change - T85757 [production]
08:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1077 - T85757 (duration: 00m 46s) [production]
08:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1123 - T85757 (duration: 00m 48s) [production]
08:10 <moritzm> installing OpenSSL security updates [production]
07:39 <marostegui> Stop replication on db1124:3313 to fix triggers - T85757 [production]
07:00 <marostegui> Stop MySQL on db1089 to clone dbstore1003 - T210478 [production]
07:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1089 T210478 (duration: 00m 47s) [production]
06:54 <marostegui> Deploy schema change on db1123 - T85757 [production]
06:54 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1123 - T85757 (duration: 00m 50s) [production]
06:47 <marostegui> Drop tag_summary table from db1023, db1077, db1075 and db1078 T212255 [production]
06:45 <vgutierrez@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5010.eqsin.wmnet [production]
06:32 <marostegui> Drop tag_summary table from db1095:3313 - T212255 [production]
06:27 <marostegui> Drop tag_summary table from dbstore1002:s3 - T212255 [production]
06:12 <marostegui> Drop tag_summary table from s3 codfw - T212255 [production]
06:08 <marostegui> tag_summary table from s8 - T212255 [production]
2019-01-20 §
15:13 <marostegui> Force WriteBack on db2040 - T214264 [production]
01:07 <cdanis> cdanis@wdqs1004.eqiad.wmnet /var/log/wdqs % sudo service wdqs-blazegraph restart [production]
2019-01-19 §
22:12 <ariel@deploy1001> Finished deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression (duration: 00m 03s) [production]
22:12 <ariel@deploy1001> Started deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression [production]
20:34 <gtirloni> upgraded and rebooted labstore200{3,4} [production]
12:34 <onimisionipe> pool maps1003 - stretch migration is complete T198622 [production]
12:08 <elukey> run 'start all slaves' on dbstore1002 after crash [production]
08:42 <marostegui> Fixing dbstore1002 x1 replication T213670 [production]
07:36 <elukey> restart pdfrender on scb1004 [production]
05:55 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 14s) [production]
05:55 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step [production]
05:55 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 15s) [production]
05:55 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step [production]
05:46 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 13s) [production]
05:46 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step [production]
05:25 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest (duration: 00m 17s) [production]
05:25 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest [production]
05:18 <legoktm@deploy1001> Synchronized php-1.33.0-wmf.13/extensions/JsonConfig/includes/JCCache.php: Revert "JCCache: Explicit load the main slot to avoid API warnings" - T214179 (duration: 00m 58s) [production]
2019-01-18 §
23:57 <mobrovac@deploy1001> Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 (duration: 01m 01s) [production]
23:56 <mobrovac@deploy1001> Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 [production]
23:55 <mobrovac@deploy1001> Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 (duration: 00m 18s) [production]
23:54 <mobrovac@deploy1001> Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 [production]
23:53 <mobrovac@deploy1001> Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 (duration: 00m 34s) [production]
23:53 <mobrovac@deploy1001> Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 [production]
20:47 <mobrovac> restbase/cassandra bootstrap restbase1016-c - T212418 [production]
20:47 <mobrovac> restbase/cassandra bootstrap restbase1016-c [production]
17:24 <godog> bootstrap cassandra-b on restbase1016 - T212418 [production]
17:06 <marostegui> Reload haproxy on dbproxy1009 after rack a2 maintenance [production]
16:14 <arturo> T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) [production]
15:36 <moritzm> rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu [production]
15:27 <moritzm> rebooting elnath to pick up SSBD-enabled qemu [production]
13:41 <marostegui> reload haproxy on dbproxy1004 [production]