|
2018-07-20
§
|
| 17:08 |
<XioNoX> |
enable ospf on eqdfw-knams link (GTT) |
[production] |
| 15:33 |
<elukey> |
rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix) |
[production] |
| 15:19 |
<elukey> |
powercycle ms-be1016 - RAID errors, no ssh available, I/O errors in com2 console |
[production] |
| 14:15 |
<reedy@deploy1001> |
rebuilt and synchronized wikiversions files: wikidatawiki back to .12 T199983 |
[production] |
| 14:11 |
<Reedy> |
T199983 wikidata wiki abck to .12 on mwdebug1001 |
[production] |
| 13:33 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1085, db1113:3316 (duration: 00m 55s) |
[production] |
| 13:13 |
<marostegui> |
Stop replication in sync db1085 and db1113:3316 |
[production] |
| 13:13 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1098:3316, depool db1113:3316 (duration: 00m 54s) |
[production] |
| 13:06 |
<legoktm@deploy1001> |
Synchronized wmf-config/throttle.php: Update Wikimania IP address - T198288 (duration: 00m 54s) |
[production] |
| 12:53 |
<marostegui> |
Stop replication in sync db1085 and db1096:3318 |
[production] |
| 12:53 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1096:3316, depool db1098:3316 (duration: 00m 54s) |
[production] |
| 12:32 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1085 and db1096:3316 (duration: 00m 56s) |
[production] |
| 12:32 |
<marostegui> |
Stop replication in sync db1085 and db1096:3316 |
[production] |
| 12:31 |
<marostegui@deploy1001> |
sync-file aborted: Depool db1085 and db1096:33156 (duration: 00m 01s) |
[production] |
| 12:00 |
<mobrovac@deploy1001> |
Finished deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 (duration: 02m 11s) |
[production] |
| 11:58 |
<mobrovac@deploy1001> |
Started deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 |
[production] |
| 10:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3312, db1105:3312 (duration: 00m 53s) |
[production] |
| 10:30 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1105:3312 - T200061 |
[production] |
| 10:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1103:3312, depool db1105:3312 (duration: 00m 54s) |
[production] |
| 10:17 |
<marostegui> |
Stop replication in sync on db1090:3312 and db2035 - T200061 |
[production] |
| 10:14 |
<marostegui> |
Stop replication in sync on db1090:3312 and db1103:3312 - T200061 |
[production] |
| 10:06 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 and db1103:3312 (duration: 00m 55s) |
[production] |
| 09:46 |
<marostegui> |
Stop replication on db2063 to fix db2095 - T200061 |
[production] |
| 08:50 |
<marostegui> |
Stop replication on s7 codfw master to check arwiki.change_tag - T200061 |
[production] |
| 08:47 |
<Amir1> |
stopping populateChangeTagDef.php (T200061) |
[production] |
| 08:41 |
<foks> |
reset email for User:Nomden |
[production] |
| 08:01 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 55s) |
[production] |
| 07:46 |
<marostegui> |
Stop replicaiton on s8 codfw master - T200061 |
[production] |
| 07:43 |
<jynus> |
stopping db1095 mariadb and cloning it to db1102 |
[production] |
| 07:14 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1099, es1019 fully (duration: 00m 54s) |
[production] |
| 07:11 |
<marostegui> |
Stop replication in sync on db1074 and db1125:3312 |
[production] |
| 06:13 |
<marostegui> |
Deploy schema change on db1074 with replication, this will generate lag on labsdb:s2 T144010 T51190 T199368 |
[production] |
| 06:12 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 53s) |
[production] |
| 06:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1076 after alter table (duration: 00m 54s) |
[production] |
| 05:49 |
<marostegui> |
Deploy schema change on db1076 T144010 T51190 T199368 |
[production] |
| 05:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1076 for alter table (duration: 00m 56s) |
[production] |
| 05:08 |
<marostegui> |
Start to remove some unused files on db1067 - T200039 |
[production] |
| 01:38 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.13/extensions/CentralAuth/includes/CentralAuthUser.php: T170971 (duration: 00m 55s) |
[production] |
| 00:31 |
<krinkle@deploy1001> |
Synchronized php-1.32.0-wmf.13/includes/filerepo/: I58706b5610 and I40f6ad2a3d - T200026 (duration: 00m 56s) |
[production] |
| 00:30 |
<ejegg> |
updated CiviCRM from 22a8c47668 to d76e3997e6 |
[production] |
| 00:12 |
<bblack> |
disabled puppet temporary on cp* and kafka-jumbo* for ipsec unconfiguration |
[production] |