6051-6100 of 10000 results (67ms)
2018-07-06 ยง
12:29 <mobrovac@deploy1001> Started deploy [restbase/deploy@c42c048]: Update restbase-mod-table-cassandra to v1.1.0 [production]
12:18 <marostegui> Deploy schema change on s2 codfw master (db2035) with replication, this will generate lag on s2 codfw T146591 T197891 T196379 [production]
11:51 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on dbstore1002:s2 - T197459 [production]
11:15 <marostegui> Optimize {itwiki,enwiktionary,nlwiki}.logging on db2035 (codfw s2 master), this will generate lag on s2 codfw - T197459 [production]
11:09 <marostegui> Optimize shwiki.logging on s3 eqiad hosts (one by one) T197459 [production]
11:08 <marostegui> Optimize shwiki.logging on db2043 (codfw s3 master), this will generate lag on s3 codfw - T197459 [production]
11:04 <marostegui> Optimize frwiki.logging on db1061 (s6 primary master) - T197459 [production]
11:02 <marostegui> Deploy schema change on db1061 (s6 primary master) T146591 T197891 T196379 [production]
11:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1088 after alter table (duration: 00m 50s) [production]
10:49 <marostegui> Optimize frwiki.logging on db1088 - T197459 [production]
10:48 <marostegui> Deploy schema change on db1088 T146591 T197891 T196379 [production]
10:48 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 for alter table (duration: 00m 50s) [production]
10:40 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1093 after alter table (duration: 00m 51s) [production]
10:02 <marostegui> Optimize frwiki.logging on db1093 - T197459 [production]
10:01 <mobrovac> restbase depool restbase2001 to test the cassandra node driver v3.5.0 - T169009 [production]
10:00 <marostegui> Deploy schema change on db1093 T146591 T197891 T196379 [production]
10:00 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093 for alter table (duration: 00m 51s) [production]
09:55 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085 after alter table (duration: 00m 51s) [production]
09:46 <marostegui> Deploy schema change on db1085 with replication, this will generate lag on s6 labsdb T146591 T197891 T196379 [production]
09:08 <jynus> restart db1115 mariadb instance (this will cause temporary downtime if tendril and dbtree) [production]
08:53 <marostegui> Optimize frwiki.logging on db11085 with replication (this will generate lag on s6 on labsdb hosts) - T197459 [production]
08:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1085 for alter table (duration: 00m 51s) [production]
08:18 <marostegui> Optimize frwiki.logging on db1113:3316 - T197459 [production]
08:15 <marostegui> Deploy schema change on db1113:3316 T146591 T197891 T196379 [production]
08:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3318 after alter table (duration: 00m 50s) [production]
07:47 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098:3316 for alter table (duration: 00m 50s) [production]
07:47 <marostegui> Optimize frwiki.logging on db1098:3316 - T197459 [production]
07:46 <marostegui@deploy1001> sync-file aborted: Depool db1098:3315 for alter table (duration: 00m 01s) [production]
07:45 <marostegui> Deploy schema change on db1098:3316 T146591 T197891 T196379 [production]
07:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 after alter table (duration: 00m 50s) [production]
07:22 <moritzm> re-enabled puppet on mw2246 [production]
07:12 <moritzm> upgrading remaining video scalers to vp9-row-mt enabled ffmpeg build (T190333) [production]
07:11 <marostegui> Optimize frwiki.logging on db1096:3316 - T197459 [production]
07:07 <marostegui> Deploy schema change on db1096:3316 T146591 T197891 T196379 [production]
07:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 for alter table (duration: 00m 51s) [production]
06:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1110 after alter table (duration: 00m 52s) [production]
06:49 <marostegui> Optimize frwiki.logging on dbstore1002 - T197459 [production]
06:34 <marostegui> Deploy schema change on dbstore1002:s6 T146591 T197891 T196379 [production]
06:31 <marostegui> Optimize frwiki.logging on db2039 (s6 codfw master), with replication, this will generate lag on s6 codfw - T197459 [production]
06:25 <marostegui> Deploy schema change on s6 codfw master (db2039) with replication, this will generate lag on s6 codfw T146591 T197891 T196379 [production]
06:22 <marostegui> Optimize dewiki.logging on db1070 (s5 primary master) - T197459 [production]
05:03 <kartik@deploy1001> Finished deploy [cxserver/deploy@6f9fcce]: Update cxserver to bfc9c84 (T198830) (duration: 03m 26s) [production]
05:01 <marostegui> Optimize dewiki.logging on db1110 - T197459 [production]
05:00 <kartik@deploy1001> Started deploy [cxserver/deploy@6f9fcce]: Update cxserver to bfc9c84 (T198830) [production]
05:00 <marostegui> Deploy schema change on s5 primary master (db1070) T146591 T197891 T196379 [production]
04:58 <marostegui> Deploy schema change on db1110 T146591 T197891 T196379 [production]
04:58 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1110 for alter table (duration: 00m 50s) [production]
04:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1082 after alter table (duration: 00m 51s) [production]
04:42 <marostegui> Deploy schema change on db1082 with replication T146591 T197891 T196379 [production]
00:08 <ejegg> updated CiviCRM from e2c8ddd70e to d24c2bc08b [production]