2018-07-20
§
|
21:50 |
<bawolff> |
deployed patch T200104 |
[production] |
17:16 |
<XioNoX> |
enable bgp on eqdfw-knams link (GTT) |
[production] |
17:08 |
<XioNoX> |
enable ospf on eqdfw-knams link (GTT) |
[production] |
15:33 |
<elukey> |
rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix) |
[production] |
15:19 |
<elukey> |
powercycle ms-be1016 - RAID errors, no ssh available, I/O errors in com2 console |
[production] |
14:15 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki back to .12 T199983 |
[production] |
14:11 |
<Reedy> |
T199983 wikidata wiki abck to .12 on mwdebug1001 |
[production] |
13:33 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1085, db1113:3316 (duration: 00m 55s) |
[production] |
13:13 |
<marostegui> |
Stop replication in sync db1085 and db1113:3316 |
[production] |
13:13 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1098:3316, depool db1113:3316 (duration: 00m 54s) |
[production] |
13:06 |
<legoktm@deploy1001> |
Synchronized wmf-config/throttle.php: Update Wikimania IP address - T198288 (duration: 00m 54s) |
[production] |
12:53 |
<marostegui> |
Stop replication in sync db1085 and db1096:3318 |
[production] |
12:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316, depool db1098:3316 (duration: 00m 54s) |
[production] |
12:32 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1085 and db1096:3316 (duration: 00m 56s) |
[production] |
12:32 |
<marostegui> |
Stop replication in sync db1085 and db1096:3316 |
[production] |
12:31 |
<marostegui@deploy1001> |
sync-file aborted: Depool db1085 and db1096:33156 (duration: 00m 01s) |
[production] |
12:00 |
<mobrovac@deploy1001> |
Finished deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 (duration: 02m 11s) |
[production] |
11:58 |
<mobrovac@deploy1001> |
Started deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 |
[production] |
10:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3312, db1105:3312 (duration: 00m 53s) |
[production] |
10:30 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1105:3312 - T200061 |
[production] |
10:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1103:3312, depool db1105:3312 (duration: 00m 54s) |
[production] |
10:17 |
<marostegui> |
Stop replication in sync on db1090:3312 and db2035 - T200061 |
[production] |
10:14 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1103:3312 - T200061 |
[production] |
10:06 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 and db1103:3312 (duration: 00m 55s) |
[production] |
09:46 |
<marostegui> |
Stop replication on db2063 to fix db2095 - T200061 |
[production] |
08:50 |
<marostegui> |
Stop replication on s7 codfw master to check arwiki.change_tag - T200061 |
[production] |
08:47 |
<Amir1> |
stopping populateChangeTagDef.php (T200061) |
[production] |
08:41 |
<foks> |
reset email for User:Nomden |
[production] |
08:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 55s) |
[production] |
07:46 |
<marostegui> |
Stop replicaiton on s8 codfw master - T200061 |
[production] |
07:43 |
<jynus> |
stopping db1095 mariadb and cloning it to db1102 |
[production] |
07:14 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1099, es1019 fully (duration: 00m 54s) |
[production] |
07:11 |
<marostegui> |
Stop replication in sync on db1074 and db1125:3312 |
[production] |
06:13 |
<marostegui> |
Deploy schema change on db1074 with replication, this will generate lag on labsdb:s2 T144010 T51190 T199368 |
[production] |
06:12 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 53s) |
[production] |
06:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1076 after alter table (duration: 00m 54s) |
[production] |
05:49 |
<marostegui> |
Deploy schema change on db1076 T144010 T51190 T199368 |
[production] |
05:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1076 for alter table (duration: 00m 56s) |
[production] |
05:08 |
<marostegui> |
Start to remove some unused files on db1067 - T200039 |
[production] |