151-200 of 10000 results (49ms)
2018-07-20 §
21:50 <bawolff> deployed patch T200104 [production]
21:44 <Lokal_Profil> dropped and recreated the `statistics` and the `monuments_nl-wd_(nl)` tables [tools.heritage]
17:16 <XioNoX> enable bgp on eqdfw-knams link (GTT) [production]
17:16 <Lokal_Profil> Manually resolving conflicts and creating a local commit. Resolving the difference to master is tracked at https://phabricator.wikimedia.org/T200101 [tools.heritage]
17:08 <XioNoX> enable ospf on eqdfw-knams link (GTT) [production]
16:52 <Lokal_Profil> Deploy latest from Git master: 4031f51 (T176733), 3b0661e (T180692), 8a60fd9, 1b69a75, ccb8fb6, c54c56b, 823ce1b, c3b7734 (T175907), 9a14fef, 962fe45, b5f3bc5, 6662976, 1b5bda8, 121cbbd, cf30736, 059ff06, 3718a5e, e61bb05, ce2b43a, b73d519, a0e9888, 6567c2a, 929a49f, 12680dd, dec0d98 [tools.heritage]
15:33 <elukey> rolling restart of eventstreams on scb2* nodes to reduce the memory pressure before the weekend (still waiting for a permanent fix) [production]
15:19 <elukey> powercycle ms-be1016 - RAID errors, no ssh available, I/O errors in com2 console [production]
14:15 <reedy@deploy1001> rebuilt and synchronized wikiversions files: wikidatawiki back to .12 T199983 [production]
14:11 <Reedy> T199983 wikidata wiki abck to .12 on mwdebug1001 [production]
13:33 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1085, db1113:3316 (duration: 00m 55s) [production]
13:13 <marostegui> Stop replication in sync db1085 and db1113:3316 [production]
13:13 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1098:3316, depool db1113:3316 (duration: 00m 54s) [production]
13:06 <legoktm@deploy1001> Synchronized wmf-config/throttle.php: Update Wikimania IP address - T198288 (duration: 00m 54s) [production]
12:53 <marostegui> Stop replication in sync db1085 and db1096:3318 [production]
12:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1096:3316, depool db1098:3316 (duration: 00m 54s) [production]
12:32 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1085 and db1096:3316 (duration: 00m 56s) [production]
12:32 <marostegui> Stop replication in sync db1085 and db1096:3316 [production]
12:31 <marostegui@deploy1001> sync-file aborted: Depool db1085 and db1096:33156 (duration: 00m 01s) [production]
12:00 <mobrovac@deploy1001> Finished deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 (duration: 02m 11s) [production]
11:58 <mobrovac@deploy1001> Started deploy [eventstreams/deploy@01fac88]: Lower librdkafka settings related to fetching messages - T199813 [production]
10:42 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1090:3312, db1105:3312 (duration: 00m 53s) [production]
10:30 <marostegui> Stop replication in sync on db1090:3312 and db1105:3312 - T200061 [production]
10:30 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312, depool db1105:3312 (duration: 00m 54s) [production]
10:17 <marostegui> Stop replication in sync on db1090:3312 and db2035 - T200061 [production]
10:14 <marostegui> Stop replication in sync on db1090:3312 and db1103:3312 - T200061 [production]
10:08 <sebastian-wmse> Deploy latest (v0.1.0) from Git master: 2a79cdd, 7522a46, c168aa7 (T194620), c201912; update MediaWiki to b8dee03 [wikispeech]
10:06 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 and db1103:3312 (duration: 00m 55s) [production]
09:46 <marostegui> Stop replication on db2063 to fix db2095 - T200061 [production]
08:50 <marostegui> Stop replication on s7 codfw master to check arwiki.change_tag - T200061 [production]
08:47 <Amir1> stopping populateChangeTagDef.php (T200061) [production]
08:41 <foks> reset email for User:Nomden [production]
08:01 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 55s) [production]
07:46 <marostegui> Stop replicaiton on s8 codfw master - T200061 [production]
07:43 <jynus> stopping db1095 mariadb and cloning it to db1102 [production]
07:20 <legoktm> cleaned up giant log files on extdist-02 [extdist]
07:14 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1099, es1019 fully (duration: 00m 54s) [production]
07:11 <marostegui> Stop replication in sync on db1074 and db1125:3312 [production]
06:13 <marostegui> Deploy schema change on db1074 with replication, this will generate lag on labsdb:s2 T144010 T51190 T199368 [production]
06:12 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 53s) [production]
06:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1076 after alter table (duration: 00m 54s) [production]
05:49 <marostegui> Deploy schema change on db1076 T144010 T51190 T199368 [production]
05:44 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1076 for alter table (duration: 00m 56s) [production]
05:08 <marostegui> Start to remove some unused files on db1067 - T200039 [production]
01:38 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.13/extensions/CentralAuth/includes/CentralAuthUser.php: T170971 (duration: 00m 55s) [production]
00:31 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.13/includes/filerepo/: I58706b5610 and I40f6ad2a3d - T200026 (duration: 00m 56s) [production]
00:30 <ejegg> updated CiviCRM from 22a8c47668 to d76e3997e6 [production]
00:12 <bblack> disabled puppet temporary on cp* and kafka-jumbo* for ipsec unconfiguration [production]
2018-07-19 §
23:43 <ejegg> updated CiviCRM from 08680be68e to 22a8c47668 [production]
23:31 <ejegg> updated CiviCRM from 2bb0d0f9d0 to 08680be68e [production]