2019-01-21
§
|
09:30 |
<marostegui> |
Compress a few tables on dbstore1003:3315 - T210478 |
[production] |
08:35 |
<marostegui> |
Stop replication db1077 to deploy schema change - T85757 |
[production] |
08:31 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1077 - T85757 (duration: 00m 46s) |
[production] |
08:24 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1123 - T85757 (duration: 00m 48s) |
[production] |
08:10 |
<moritzm> |
installing OpenSSL security updates |
[production] |
07:39 |
<marostegui> |
Stop replication on db1124:3313 to fix triggers - T85757 |
[production] |
07:00 |
<marostegui> |
Stop MySQL on db1089 to clone dbstore1003 - T210478 |
[production] |
07:00 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1089 T210478 (duration: 00m 47s) |
[production] |
06:54 |
<marostegui> |
Deploy schema change on db1123 - T85757 |
[production] |
06:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1123 - T85757 (duration: 00m 50s) |
[production] |
06:47 |
<marostegui> |
Drop tag_summary table from db1023, db1077, db1075 and db1078 T212255 |
[production] |
06:45 |
<vgutierrez@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp5010.eqsin.wmnet |
[production] |
06:32 |
<marostegui> |
Drop tag_summary table from db1095:3313 - T212255 |
[production] |
06:27 |
<marostegui> |
Drop tag_summary table from dbstore1002:s3 - T212255 |
[production] |
06:12 |
<marostegui> |
Drop tag_summary table from s3 codfw - T212255 |
[production] |
06:08 |
<marostegui> |
tag_summary table from s8 - T212255 |
[production] |
2019-01-19
§
|
22:12 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression (duration: 00m 03s) |
[production] |
22:12 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression |
[production] |
20:34 |
<gtirloni> |
upgraded and rebooted labstore200{3,4} |
[production] |
12:34 |
<onimisionipe> |
pool maps1003 - stretch migration is complete T198622 |
[production] |
12:08 |
<elukey> |
run 'start all slaves' on dbstore1002 after crash |
[production] |
08:42 |
<marostegui> |
Fixing dbstore1002 x1 replication T213670 |
[production] |
07:36 |
<elukey> |
restart pdfrender on scb1004 |
[production] |
05:55 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 14s) |
[production] |
05:55 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
05:55 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 15s) |
[production] |
05:55 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
05:46 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 13s) |
[production] |
05:46 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
05:25 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest (duration: 00m 17s) |
[production] |
05:25 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest |
[production] |
05:18 |
<legoktm@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/JsonConfig/includes/JCCache.php: Revert "JCCache: Explicit load the main slot to avoid API warnings" - T214179 (duration: 00m 58s) |
[production] |
2019-01-18
§
|
23:57 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 (duration: 01m 01s) |
[production] |
23:56 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 |
[production] |
23:55 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 (duration: 00m 18s) |
[production] |
23:54 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 |
[production] |
23:53 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 (duration: 00m 34s) |
[production] |
23:53 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 |
[production] |
20:47 |
<mobrovac> |
restbase/cassandra bootstrap restbase1016-c - T212418 |
[production] |
20:47 |
<mobrovac> |
restbase/cassandra bootstrap restbase1016-c |
[production] |
17:24 |
<godog> |
bootstrap cassandra-b on restbase1016 - T212418 |
[production] |
17:06 |
<marostegui> |
Reload haproxy on dbproxy1009 after rack a2 maintenance |
[production] |
16:14 |
<arturo> |
T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) |
[production] |
15:36 |
<moritzm> |
rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu |
[production] |
15:27 |
<moritzm> |
rebooting elnath to pick up SSBD-enabled qemu |
[production] |
13:41 |
<marostegui> |
reload haproxy on dbproxy1004 |
[production] |
13:18 |
<godog> |
start cassandra-a on restbase1016 - T212418 |
[production] |
13:07 |
<mbsantos@deploy1001> |
Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) |
[production] |