251-300 of 10000 results (33ms)
2018-08-24 §
11:58 <elukey> upgrade nodejs packages on aqs* for security upgrade (rolling restart of aqs daemon included) [production]
11:19 <ema> powercycle cp3030, stuck rebooting T200445 [production]
10:47 <moritzm> reimage wtp2008-wtp2010 to stretch [production]
09:28 <moritzm> reimage wtp2005-wtp2007 to stretch [production]
09:09 <marostegui> Restart MySQL on db2035 (codfw s2 master) for mysql upgrade and pick up new mysql options after merging https://gerrit.wikimedia.org/r/455103 [production]
09:04 <marostegui> Deploy schema change on db1095:3312 [production]
07:56 <marostegui> Deploy schema change on db1122 [production]
07:53 <moritzm> reimage wtp2002-wtp2004 to stretch [production]
06:52 <marostegui> Deploy schema change on db1074 with replication (this will generate lag on s2 labs) [production]
06:38 <moritzm> reimage wtp2001 to stretch [production]
06:09 <moritzm> imported php-igbinary, libzip5, php-apcu-bc to thirdparty/php72 (T202704) [production]
05:26 <marostegui> Deploy schema change on db1076 [production]
00:21 <mutante> ms-be2043 - mount -a ; re-enabled puppet, running puppet [production]
2018-08-23 §
23:47 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202548 (duration: 01m 01s) [production]
23:43 <Reedy> created wikilove tables on zh_yuewiki T202548 [production]
23:42 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T201236 (duration: 00m 55s) [production]
23:37 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 53s) [production]
23:34 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202599 (duration: 00m 49s) [production]
23:28 <Reedy> running `mwscript updateCollation.php --wiki=trwiki --previous-collation=uppercase` T184943 [production]
23:28 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T184943 (duration: 00m 48s) [production]
23:23 <reedy@deploy1001> Synchronized wmf-config/flaggedrevs.php: T202139 (duration: 00m 48s) [production]
23:19 <reedy@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T202680 (duration: 00m 48s) [production]
23:16 <reedy@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/2cc7028226a539553178454fc2f14459 for details) [production]
23:16 <reedy@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 01s) [production]
23:15 <reedy@deploy1001> sync-file aborted: (no justification provided) (duration: 00m 00s) [production]
22:53 <XioNoX> Add v4 session in eqdfw to AS8075 [production]
22:46 <XioNoX> Add v6 session in eqsin to 10089 [production]
22:39 <XioNoX> deactivating down AMSIX peer (no reply to emails) [production]
22:36 <XioNoX> clear peer 80.249.208.51 AS 8708 on cr2-esams [production]
22:31 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 [production]
22:27 <thcipriani@deploy1001> Synchronized php-1.32.0-wmf.18/extensions/FlaggedRevs/backend/FlaggedRevs.class.php: [[gerrit:455017|Follow-up 413e11e2f: Skip CurrentRevisionCallback if not stabilized]] T202659 (duration: 00m 56s) [production]
19:34 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: revert all wikis to 1.32.0-wmf.18 [production]
19:34 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. (duration: 03m 27s) [production]
19:31 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 5, onthisday is timing out. Just push this through.. [production]
19:26 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.32.0-wmf.18 [production]
18:54 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. (duration: 04m 39s) [production]
18:50 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 4, onthisday is timing out. Just push this through.. [production]
18:48 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. (duration: 03m 59s) [production]
18:44 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is timing out. Just push this through.. [production]
18:41 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing (duration: 03m 53s) [production]
18:37 <thcipriani@deploy1001> Synchronized php: group1 wikis to 1.32.0-wmf.18 (duration: 00m 54s) [production]
18:37 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 3, onthisday is failing [production]
18:37 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing (duration: 06m 30s) [production]
18:37 <thcipriani@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.18 [production]
18:33 <XioNoX> Equinix updated their MAC filter, IX sessions up - T196941 [production]
18:33 <thcipriani> starting train a little early to play catchup [production]
18:32 <RoanKattouw> Deployed patch for T199993 [production]
18:30 <ppchelko@deploy1001> Started deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage, take 2, onthisday is failing [production]
18:30 <ppchelko@deploy1001> Finished deploy [restbase/deploy@b2b61e8]: Resurrect MCS on wikivoyage (duration: 03m 54s) [production]
18:30 <XioNoX> remove MAC filter workaround on cr2-eqdfw - T196941 [production]