|
2018-08-24
§
|
| 11:19 |
<ema> |
powercycle cp3030, stuck rebooting T200445 |
[production] |
| 10:47 |
<moritzm> |
reimage wtp2008-wtp2010 to stretch |
[production] |
| 09:28 |
<moritzm> |
reimage wtp2005-wtp2007 to stretch |
[production] |
| 09:09 |
<marostegui> |
Restart MySQL on db2035 (codfw s2 master) for mysql upgrade and pick up new mysql options after merging https://gerrit.wikimedia.org/r/455103 |
[production] |
| 09:04 |
<marostegui> |
Deploy schema change on db1095:3312 |
[production] |
| 07:56 |
<marostegui> |
Deploy schema change on db1122 |
[production] |
| 07:53 |
<moritzm> |
reimage wtp2002-wtp2004 to stretch |
[production] |
| 06:52 |
<marostegui> |
Deploy schema change on db1074 with replication (this will generate lag on s2 labs) |
[production] |
| 06:38 |
<moritzm> |
reimage wtp2001 to stretch |
[production] |
| 06:09 |
<moritzm> |
imported php-igbinary, libzip5, php-apcu-bc to thirdparty/php72 (T202704) |
[production] |
| 05:26 |
<marostegui> |
Deploy schema change on db1076 |
[production] |
| 00:21 |
<mutante> |
ms-be2043 - mount -a ; re-enabled puppet, running puppet |
[production] |
|
2018-08-23
§
|
| 23:47 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T202548 (duration: 01m 01s) |
[production] |
| 23:43 |
<Reedy> |
created wikilove tables on zh_yuewiki T202548 |
[production] |
| 23:42 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T201236 (duration: 00m 55s) |
[production] |
| 23:37 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 53s) |
[production] |
| 23:34 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 49s) |
[production] |
| 23:28 |
<Reedy> |
running `mwscript updateCollation.php --wiki=trwiki --previous-collation=uppercase` T184943 |
[production] |
| 23:28 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T184943 (duration: 00m 48s) |
[production] |
| 23:23 |
<reedy@deploy1001> |
Synchronized wmf-config/flaggedrevs.php: T202139 (duration: 00m 48s) |
[production] |
| 23:19 |
<reedy@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: T202680 (duration: 00m 48s) |
[production] |
| 23:16 |
<reedy@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) |
[production] |
| 23:16 |
<reedy@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 01s) |
[production] |
| 23:15 |
<reedy@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 00s) |
[production] |
| 22:53 |
<XioNoX> |
Add v4 session in eqdfw to AS8075 |
[production] |
| 22:46 |
<XioNoX> |
Add v6 session in eqsin to 10089 |
[production] |
| 22:39 |
<XioNoX> |
deactivating down AMSIX peer (no reply to emails) |
[production] |
| 22:36 |
<XioNoX> |
clear peer 80.249.208.51 AS 8708 on cr2-esams |
[production] |
| 22:31 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 |
[production] |
| 22:27 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:455017|Follow-up 413e11e2f: Skip CurrentRevisionCallback if not stabilized]] T202659 (duration: 00m 56s) |
[production] |
| 19:34 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: revert all wikis to 1.32.0-wmf.18 |
[production] |
| 19:34 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. (duration: 03m 27s) |
[production] |
| 19:31 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. |
[production] |
| 19:26 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 |
[production] |
| 18:54 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. (duration: 04m 39s) |
[production] |
| 18:50 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. |
[production] |
| 18:48 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. (duration: 03m 59s) |
[production] |
| 18:44 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. |
[production] |
| 18:41 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing (duration: 03m 53s) |
[production] |
| 18:37 |
<thcipriani@deploy1001> |
Synchronized php: group1 wikis to 1.32.0-wmf.18 (duration: 00m 54s) |
[production] |
| 18:37 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing |
[production] |
| 18:37 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing (duration: 06m 30s) |
[production] |
| 18:37 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.18 |
[production] |
| 18:33 |
<XioNoX> |
Equinix updated their MAC filter, IX sessions up - T196941 |
[production] |
| 18:33 |
<thcipriani> |
starting train a little early to play catchup |
[production] |
| 18:32 |
<RoanKattouw> |
Deployed patch for T199993 |
[production] |
| 18:30 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing |
[production] |
| 18:30 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage (duration: 03m 54s) |
[production] |
| 18:30 |
<XioNoX> |
remove MAC filter workaround on cr2-eqdfw - T196941 |
[production] |
| 18:28 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:454868|Fix incorrect return value in CurrentRevisionCallback]] T202580 (duration: 00m 54s) |
[production] |