|
2019-01-19
§
|
| 12:08 |
<elukey> |
run 'start all slaves' on dbstore1002 after crash |
[production] |
| 08:42 |
<marostegui> |
Fixing dbstore1002 x1 replication T213670 |
[production] |
| 07:36 |
<elukey> |
restart pdfrender on scb1004 |
[production] |
| 05:55 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 14s) |
[production] |
| 05:55 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
| 05:55 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 15s) |
[production] |
| 05:55 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
| 05:46 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 13s) |
[production] |
| 05:46 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step |
[production] |
| 05:25 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest (duration: 00m 17s) |
[production] |
| 05:25 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest |
[production] |
| 05:18 |
<legoktm@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/JsonConfig/includes/JCCache.php: Revert "JCCache: Explicit load the main slot to avoid API warnings" - T214179 (duration: 00m 58s) |
[production] |
|
2019-01-18
§
|
| 23:57 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 (duration: 01m 01s) |
[production] |
| 23:56 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 |
[production] |
| 23:55 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 (duration: 00m 18s) |
[production] |
| 23:54 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 |
[production] |
| 23:53 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 (duration: 00m 34s) |
[production] |
| 23:53 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 |
[production] |
| 20:47 |
<mobrovac> |
restbase/cassandra bootstrap restbase1016-c - T212418 |
[production] |
| 20:47 |
<mobrovac> |
restbase/cassandra bootstrap restbase1016-c |
[production] |
| 17:24 |
<godog> |
bootstrap cassandra-b on restbase1016 - T212418 |
[production] |
| 17:06 |
<marostegui> |
Reload haproxy on dbproxy1009 after rack a2 maintenance |
[production] |
| 16:14 |
<arturo> |
T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) |
[production] |
| 15:36 |
<moritzm> |
rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu |
[production] |
| 15:27 |
<moritzm> |
rebooting elnath to pick up SSBD-enabled qemu |
[production] |
| 13:41 |
<marostegui> |
reload haproxy on dbproxy1004 |
[production] |
| 13:18 |
<godog> |
start cassandra-a on restbase1016 - T212418 |
[production] |
| 13:07 |
<mbsantos@deploy1001> |
Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) |
[production] |
| 13:06 |
<mbsantos@deploy1001> |
Started deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed |
[production] |
| 12:50 |
<moritzm> |
uploaded ferm 2.4-1+wmf1 to buster-wikimedia (T213527) |
[production] |
| 11:46 |
<moritzm> |
copied prometheus-rsyslog-exporter from stretch-wikimedia to buster-wikimedia |
[production] |
| 11:09 |
<marostegui> |
Deploy schema change on db2039 (s6 codfw master) - T210713 |
[production] |
| 10:54 |
<marostegui> |
Deploy schema change on dbstore2001:3316 - T210713 |
[production] |
| 10:42 |
<jynus> |
killing and removing data from db1118 |
[production] |
| 10:41 |
<marostegui> |
Deploy schema change on db2076 - T210713 |
[production] |
| 10:29 |
<vgutierrez> |
restarting pybal in lvs2002 - T214072 |
[production] |
| 10:23 |
<marostegui> |
Deploy schema change on db2087:3316 - T210713 |
[production] |
| 10:23 |
<vgutierrez> |
restarting pybal in lvs2005 - T214072 |
[production] |
| 10:02 |
<marostegui> |
Add dbstore1003:3315 to zarcillo - T210478 |
[production] |
| 09:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) |
[production] |
| 09:57 |
<marostegui> |
Add dbstore1003:3315 to tendril - T210478 |
[production] |
| 09:52 |
<marostegui> |
Deploy schema change on db2089 - T210713 |
[production] |
| 09:35 |
<marostegui> |
Deploy schema change on db2067 - T210713 |
[production] |
| 09:29 |
<_joe_> |
uploading python{,3}-pygerrit2 to stretch-wikimedia, T214149 |
[production] |
| 09:23 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-codfw.php: Add migrated wikis from s3 to s5 to codfw config T184805 (duration: 00m 45s) |
[production] |
| 09:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113:3316 after mysql upgrade (duration: 00m 46s) |
[production] |
| 08:12 |
<godog> |
depool and take snapshots of prometheus data on prometheus2003 to test v2 conversion - T187987 |
[production] |
| 07:31 |
<moritzm> |
rolling restart of AQS to pick up OpenSSL security updates for nodejs |
[production] |
| 07:30 |
<marostegui> |
Stop MySQL on db1113:3315 and db1113:3316 to clone dbstore1003 and for mysql and kernel upgrade |
[production] |
| 07:29 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1113:3316 for mysql upgrade (duration: 00m 45s) |
[production] |