|
2018-08-23
ยง
|
| 23:19 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T202680 (duration: 00m 48s) |
[production] |
| 23:16 |
<reedy@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) |
[production] |
| 23:16 |
<reedy@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 01s) |
[production] |
| 23:15 |
<reedy@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 00s) |
[production] |
| 22:53 |
<XioNoX> |
Add v4 session in eqdfw to AS8075 |
[production] |
| 22:46 |
<XioNoX> |
Add v6 session in eqsin to 10089 |
[production] |
| 22:39 |
<XioNoX> |
deactivating down AMSIX peer (no reply to emails) |
[production] |
| 22:36 |
<XioNoX> |
clear peer 80.249.208.51 AS 8708 on cr2-esams |
[production] |
| 22:31 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 |
[production] |
| 22:27 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:455017|Follow-up 413e11e2f: Skip CurrentRevisionCallback if not stabilized]] T202659 (duration: 00m 56s) |
[production] |
| 19:34 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: revert all wikis to 1.32.0-wmf.18 |
[production] |
| 19:34 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. (duration: 03m 27s) |
[production] |
| 19:31 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. |
[production] |
| 19:26 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 |
[production] |
| 18:54 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. (duration: 04m 39s) |
[production] |
| 18:50 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. |
[production] |
| 18:48 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. (duration: 03m 59s) |
[production] |
| 18:44 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. |
[production] |
| 18:41 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing (duration: 03m 53s) |
[production] |
| 18:37 |
<thcipriani@deploy1001> |
Synchronized php: group1 wikis to 1.32.0-wmf.18 (duration: 00m 54s) |
[production] |
| 18:37 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing |
[production] |
| 18:37 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing (duration: 06m 30s) |
[production] |
| 18:37 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.18 |
[production] |
| 18:33 |
<XioNoX> |
Equinix updated their MAC filter, IX sessions up - T196941 |
[production] |
| 18:33 |
<thcipriani> |
starting train a little early to play catchup |
[production] |
| 18:32 |
<RoanKattouw> |
Deployed patch for T199993 |
[production] |
| 18:30 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing |
[production] |
| 18:30 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage (duration: 03m 54s) |
[production] |
| 18:30 |
<XioNoX> |
remove MAC filter workaround on cr2-eqdfw - T196941 |
[production] |
| 18:28 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:454868|Fix incorrect return value in CurrentRevisionCallback]] T202580 (duration: 00m 54s) |
[production] |
| 18:28 |
<RoanKattouw> |
Deployed patch for T151910 |
[production] |
| 18:26 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage |
[production] |
| 18:15 |
<otto@deploy1001> |
Finished deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 with requirements setup (duration: 00m 03s) |
[production] |
| 18:15 |
<otto@deploy1001> |
Started deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 with requirements setup |
[production] |
| 18:09 |
<otto@deploy1001> |
Finished deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 (duration: 00m 36s) |
[production] |
| 18:08 |
<otto@deploy1001> |
Started deploy [analytics/superset/deploy@de75f23]: 0.26.3 to analytics-tool1003 |
[production] |
| 17:28 |
<XioNoX> |
enable v4 neighbors on cr2-eqdfw - T196941 |
[production] |
| 17:16 |
<XioNoX> |
enable v6 neighbors on cr2-eqdfw - T196941 |
[production] |
| 17:01 |
<XioNoX> |
powering off cr1-eqdfw - T196941 |
[production] |
| 16:49 |
<filippo@neodymium> |
conftool action : set/pooled=yes; selector: name=restbase2003.codfw.wmnet |
[production] |
| 16:22 |
<godog> |
depool and cassandra-drain restbase2003, then reboot |
[production] |
| 16:20 |
<filippo@neodymium> |
conftool action : set/pooled=no; selector: name=restbase2003.codfw.wmnet |
[production] |
| 16:17 |
<XioNoX> |
deactivating IX/Transit links on cr1-eqdfw - T196941 |
[production] |
| 16:15 |
<godog> |
upgrade hp raid firmware on restbase2003 - T201804 T141756 |
[production] |
| 15:15 |
<marostegui> |
Deploy schema change on db1090:3312 |
[production] |
| 15:14 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 54s) |
[production] |
| 15:14 |
<jynus> |
upgrading db2089 |
[production] |
| 15:08 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 (duration: 00m 55s) |
[production] |
| 15:02 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1113 (duration: 00m 54s) |
[production] |
| 14:47 |
<jynus> |
upgrading db1113 |
[production] |