1301-1350 of 10000 results (21ms)
2016-06-30 §
09:13 <godog> reboot graphite2001 / graphite1001 to apply trusty kernel update [production]
09:13 <dcausse> deleting old logs on elastic1045 and elastic1036 [production]
06:57 <moritzm> powercycling elastic1015, stuck after reboot [production]
06:37 <moritzm> powercycling elastic1014, stuck after reboot [production]
06:26 <moritzm> resuming rolling restarts of elasticsearch cluster in eqiad and codfw [production]
06:18 <moritzm> rolling restart of mw1001-mw1016 for kernel secuity update [production]
03:00 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Jun 30 03:00:28 UTC 2016 (duration 7m 10s) [production]
02:53 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.8) (duration: 07m 08s) [production]
02:39 <mwdeploy@tin> scap sync-l10n completed (1.28.0-wmf.7) (duration: 17m 23s) [production]
01:33 <twentyafterfour> starting phd with only 4 taskmasters to help lighten the load [production]
01:30 <twentyafterfour> stopped phd on iridium to investigate large spike in sql insert volume [production]
01:18 <mutante> iridium back up, on 3.13.0-91 [production]
01:15 <mutante> rebooting iridium [production]
00:39 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Don't use always true wmgUseXFFBlocks anymore (2/2) (duration: 00m 25s) [production]
00:38 <twentyafterfour> Phabricator upgrade complete, service appears to be stable. [production]
00:32 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Don't use always true wmgUseXFFBlocks anymore (1/2) (duration: 00m 25s) [production]
00:30 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Don't use always true wmgUseXFFBlocks anymore (1/2) (duration: 00m 27s) [production]
00:27 <twentyafterfour> Taking phabricator offline momentarily for scheduled update. Expect less than 5 minutes of downtime. [production]
00:25 <maxsem@tin> Synchronized wmf-config/: Try again? (duration: 00m 29s) [production]
00:16 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Revert "Cleanup: Move never-altered GlobalBlockingBlockXFF into CommonSettings" (no-op) (duration: 00m 26s) [production]
00:15 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Revert "Cleanup: Move never-altered GlobalBlockingBlockXFF into CommonSettings" (duration: 00m 25s) [production]
00:10 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Clean-up for IS/CS ([[Gerrit:292615]] to [[Gerrit:292618]], no op, 2/2) (duration: 00m 29s) [production]
00:09 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Clean-up for IS/CS ([[Gerrit:292615]] to [[Gerrit:292618]], no op, 1/2) (duration: 00m 28s) [production]
00:08 <maxsem@tin> Synchronized php-1.28.0-wmf.8/extensions/TemplateSandbox: https://gerrit.wikimedia.org/r/#/c/296675/ (duration: 00m 30s) [production]
00:08 <dereckson@tin> scap aborted: wmf-config/CommonSettings.php Clean-up for IS/CS ([[Gerrit:292615]] to [[Gerrit:292618]], no op, 1/2) (duration: 00m 20s) [production]
00:07 <dereckson@tin> Started scap: wmf-config/CommonSettings.php Clean-up for IS/CS ([[Gerrit:292615]] to [[Gerrit:292618]], no op, 1/2) [production]
2016-06-29 §
23:21 <dereckson@tin> Synchronized wmf-config/InitialiseSettings.php: Revert "Enable Echo transition flags in production for testing" (duration: 00m 25s) [production]
22:50 <demon@tin> Synchronized wmf-config/CommonSettings.php: extdist config for 1.27/1.25 (duration: 00m 31s) [production]
21:43 <krenair@tin> Synchronized php-1.28.0-wmf.8/extensions/VisualEditor/ApiVisualEditor.php: https://gerrit.wikimedia.org/r/296661 - VE namespaces issue (duration: 00m 26s) [production]
21:41 <chasemp> cleared phab 2fa for ebernhardson for lost phone [production]
21:34 <jynus> removing /srv/backups/m2-otrs-* (tranferred to es2001) to make space [production]
21:01 <yurik> deployed Graphoid https://gerrit.wikimedia.org/r/#/c/296498/ [production]
20:55 <yurik> deployed Tilerator https://gerrit.wikimedia.org/r/#/c/296647/ [production]
20:50 <yurik> deployed Kartotherian https://gerrit.wikimedia.org/r/#/c/296646/ [production]
20:21 <bearND> mobileapps deployed 1da6bf0 [production]
20:15 <bearND> starting mobileapps deploy [production]
19:54 <maxsem@tin> Synchronized wmf-config/throttle.php: https://gerrit.wikimedia.org/r/#/c/296627/ (duration: 00m 31s) [production]
19:38 <mutante> antimony - shutdown -h now (since it's gone from Icinga now) [production]
19:38 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: testwikidata back to wmf.8 [production]
19:36 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: Roll back wikidata and testwikidata to 1.28.0-wmf.7 per request by @aude [production]
19:22 <mutante> antimony puppetstoredconfigclean.rb to remove icinga monitor remnants [production]
19:14 <ostriches> ytterbium: running puppet and reloading replication plugin [production]
19:13 <mutante> antimony - stopping gitblit service [production]
19:07 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.8T138555 [production]
18:39 <demon@tin> Synchronized php-1.28.0-wmf.7/maintenance/dumpBackup.php: Deploy I94ca4a06 (duration: 00m 25s) [production]
18:39 <demon@tin> Synchronized php-1.28.0-wmf.7/maintenance/backup.inc: Deploy I94ca4a06 (duration: 00m 24s) [production]
18:37 <demon@tin> Synchronized php-1.28.0-wmf.7/includes/export/WikiExporter.php: Deploy I94ca4a06 (duration: 00m 25s) [production]
18:30 <demon@tin> Synchronized php-1.28.0-wmf.8/maintenance/dumpBackup.php: Deploy I94ca4a06 (duration: 00m 27s) [production]
18:29 <demon@tin> Synchronized php-1.28.0-wmf.8/maintenance/backup.inc: Deploy I94ca4a06 (duration: 00m 33s) [production]
18:28 <demon@tin> Synchronized php-1.28.0-wmf.8/includes/export/WikiExporter.php: Deploy I94ca4a06 (duration: 00m 34s) [production]