2551-2600 of 10000 results (65ms)
2018-08-23 ยง
23:23 <reedy@deploy1001> Synchronized wmf-config/flaggedrevs.php: T202139 (duration: 00m 48s) [production]
23:19 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202680 (duration: 00m 48s) [production]
23:16 <reedy@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
23:16 <reedy@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 01s) [production]
23:15 <reedy@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 00s) [production]
22:53 <XioNoX> Add v4 session in eqdfw to AS8075 [production]
22:46 <XioNoX> Add v6 session in eqsin to 10089 [production]
22:39 <XioNoX> deactivating down AMSIX peer (no reply to emails) [production]
22:36 <XioNoX> clear peer 80.249.208.51 AS 8708 on cr2-esams [production]
22:31 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 [production]
22:27 <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:455017|Follow-up 413e11e2f: Skip CurrentRevisionCallback if not stabilized]] T202659 (duration: 00m 56s) [production]
19:34 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: revert all wikis to 1.32.0-wmf.18 [production]
19:34 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. (duration: 03m 27s) [production]
19:31 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. [production]
19:26 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 [production]
18:54 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. (duration: 04m 39s) [production]
18:50 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. [production]
18:48 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. (duration: 03m 59s) [production]
18:44 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. [production]
18:41 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing (duration: 03m 53s) [production]
18:37 <thcipriani@deploy1001> Synchronized php: group1 wikis to 1.32.0-wmf.18 (duration: 00m 54s) [production]
18:37 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing [production]
18:37 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing (duration: 06m 30s) [production]
18:37 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.18 [production]
18:33 <XioNoX> Equinix updated their MAC filter, IX sessions up - T196941 [production]
18:33 <thcipriani> starting train a little early to play catchup [production]
18:32 <RoanKattouw> Deployed patch for T199993 [production]
18:30 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing [production]
18:30 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage (duration: 03m 54s) [production]
18:30 <XioNoX> remove MAC filter workaround on cr2-eqdfw - T196941 [production]
18:28 <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:454868|Fix incorrect return value in CurrentRevisionCallback]] T202580 (duration: 00m 54s) [production]
18:28 <RoanKattouw> Deployed patch for T151910 [production]
18:26 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage [production]
18:15 <otto@deploy1001> Finished deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 with requirements setup (duration: 00m 03s) [production]
18:15 <otto@deploy1001> Started deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 with requirements setup [production]
18:09 <otto@deploy1001> Finished deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 (duration: 00m 36s) [production]
18:08 <otto@deploy1001> Started deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 [production]
17:28 <XioNoX> enable v4 neighbors on cr2-eqdfw - T196941 [production]
17:16 <XioNoX> enable v6 neighbors on cr2-eqdfw - T196941 [production]
17:01 <XioNoX> powering off cr1-eqdfw - T196941 [production]
16:49 <filippo@neodymium> conftool action : set/pooled=yes; selector: name=restbase2003.codfw.wmnet [production]
16:22 <godog> depool and cassandra-drain restbase2003, then reboot [production]
16:20 <filippo@neodymium> conftool action : set/pooled=no; selector: name=restbase2003.codfw.wmnet [production]
16:17 <XioNoX> deactivating IX/Transit links on cr1-eqdfw - T196941 [production]
16:15 <godog> upgrade hp raid firmware on restbase2003 - T201804 T141756 [production]
15:15 <marostegui> Deploy schema change on db1090:3312 [production]
15:14 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 54s) [production]
15:14 <jynus> upgrading db2089 [production]
15:08 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 (duration: 00m 55s) [production]
15:02 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1113 (duration: 00m 54s) [production]