1351-1400 of 10000 results (47ms)
2017-11-27 §
12:14 <marostegui> Stop replication on db1109 to test table rename for s5/s8 failover [production]
12:09 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@47d27dc]: Enable keep-alive T181007 (duration: 01m 03s) [production]
12:08 <ppchelko@tin> Started deploy [cpjobqueue/deploy@47d27dc]: Enable keep-alive T181007 [production]
11:47 <addshore@tin> Synchronized wmf-config/CommonSettings-labs.php: [[gerrit:393577]] LABS ONLY Enable FileImporter & FileExporter on BETA PT2/2 (T181383) (duration: 00m 45s) [production]
11:46 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: [[gerrit:393577]] LABS ONLY Enable FileImporter & FileExporter on BETA PT1/2 (T181383) (duration: 00m 45s) [production]
11:44 <addshore@tin> Synchronized wmf-config/extension-list-labs: [[gerrit:393576]] BETA ONLY Add FileExporter & FileImporter to extension-list-labs (duration: 00m 45s) [production]
11:27 <hashar> contint1001 enable Icinga "Disks space" notification again. It is no more complaing about Docker partitions | ping mutante | T178454 [production]
11:17 <godog> bootstrap restbase1007-a - T179422 [production]
11:05 <jdrewniak@tin> Synchronized portals: Wikimedia Portals Update: [[gerrit:393559|Bumping portals to master (T128546)]] (duration: 00m 45s) [production]
11:05 <jdrewniak@tin> Synchronized portals/prod/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:393559|Bumping portals to master (T128546)]] (duration: 00m 46s) [production]
10:53 <moritzm> installing postgresql-common security updates [production]
10:08 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@e35aa05]: Revert using keep-alive (duration: 00m 22s) [production]
10:08 <ppchelko@tin> Started deploy [cpjobqueue/deploy@e35aa05]: Revert using keep-alive [production]
09:42 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@b570d4e]: Make http agent use keep-alive (duration: 00m 48s) [production]
09:41 <ppchelko@tin> Started deploy [cpjobqueue/deploy@b570d4e]: Make http agent use keep-alive [production]
09:14 <godog> reimage restbase1007 - T179422 [production]
08:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully pool db1097:3314 - T178359 (duration: 00m 43s) [production]
08:40 <moritzm> installing openjdk security updates on hadoop, druid and kafka clusters [production]
08:27 <marostegui> Deploy schema change on dbstore1002 and dbstore1001 - T174569 [production]
08:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1097:3314 weight - T178359 (duration: 00m 45s) [production]
07:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1097:3314 weight - T178359 (duration: 00m 45s) [production]
07:10 <marostegui> Stop MySQL on db1021 as it will be decommissioned - T181378 [production]
06:53 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Remove db1021 from the config as it will be decommissioned - T181378 (duration: 00m 44s) [production]
06:52 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Remove db1021 from the config as it will be decommissioned - T181378 (duration: 00m 45s) [production]
06:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Pool db1097:3314 with low weight - T178359 (duration: 00m 46s) [production]
02:22 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.8) (duration: 05m 44s) [production]
2017-11-25 §
19:31 <marostegui> Set 32:3 disk to offline on db1051 [production]
16:09 <kartik@tin> Finished deploy [cxserver/deploy@11aecc9]: Update cxserver to 0c242c0, Pin service-runner to 2.4.2 (duration: 03m 29s) [production]
16:05 <kartik@tin> Started deploy [cxserver/deploy@11aecc9]: Update cxserver to 0c242c0, Pin service-runner to 2.4.2 [production]
16:05 <godog> unban statsd traffic from scb on graphite1001 - T181333 [production]
15:45 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@e35aa05]: Rollback. Disable GC metric reporting T181333 (duration: 00m 31s) [production]
15:45 <ppchelko@tin> Started deploy [cpjobqueue/deploy@e35aa05]: Rollback. Disable GC metric reporting T181333 [production]
15:37 <volans> restarted statsd-proxy on graphite1001 (died during investigation) T181333 [production]
14:34 <godog> rolling restart of cxserver to alleviate metrics leak - T181333 [production]
14:26 <godog> restart cxserver on scb100[34] - T181333 [production]
14:10 <godog> roll-restart cpjobqueue to alleviate metrics leak - T181333 [production]
13:40 <godog> drop incoming statsd from scb to graphite1001 temporarily - T181333 [production]
08:32 <ariel@tin> Finished deploy [dumps/dumps@ec21673]: fix abstracts recombine job (duration: 00m 02s) [production]
08:32 <ariel@tin> Started deploy [dumps/dumps@ec21673]: fix abstracts recombine job [production]
2017-11-24 §
13:52 <moritzm> removing git packages from jessie-wikimedia/experimental (replaced by component/git) [production]
13:24 <moritzm> installing openjpeg2 updates (original security already got installed after initial release, but there was a binNMU for amd64) [production]
13:17 <marostegui> Stop replication on db1097 to reimport and recompress commonswiki.watchlist [production]
12:54 <jynus> reenabling puppet on db1071 [production]
12:50 <jynus> resetting replication on es1011 for consistency with other replica sets [production]
12:40 <jynus> setting up s8 topology on eqiad [production]
12:38 <jynus> disable puppet on db1071 and stop local s5 heartbeat there [production]
12:32 <reedy@tin> Synchronized docroot/mediawiki/keys/: Fixup keys (duration: 00m 45s) [production]
12:13 <marostegui> Enable GTID on es2018 - T181293 [production]
11:57 <marostegui> Disable puppet on es2018 - T181293 [production]
11:50 <jynus@tin> Synchronized wmf-config/db-codfw.php: depool es2018 T181293 (duration: 00m 45s) [production]