4051-4100 of 10000 results (42ms)
2015-10-07 §
05:25 <ebernhardson> generating elasticsearch indices in codfw, should run ~3 hours [production]
04:33 <ebernhardson@tin> Synchronized wmf-config/InitialiseSettings.php: Touch InitiialiSettings.php to force config regeneration (duration: 00m 18s) [production]
04:23 <ebernhardson@tin> Synchronized wmf-config/: enable second es cluster in testwiki one more time (duration: 00m 18s) [production]
04:15 <ebernhardson> sync-common on mw2187.codfw.wmnet to fix localisation cache errors in exception.log [production]
03:37 <ebernhardson@tin> Synchronized wmf-config: redisable second cluster only on testwiki (duration: 00m 16s) [production]
03:35 <ebernhardson@tin> Synchronized wmf-config/: Reenable second ES cluster on testwiki only (duration: 00m 18s) [production]
03:10 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-07 03:10:02+00:00 [production]
03:03 <l10nupdate@tin> Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 10m 18s) [production]
02:37 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-07 02:37:32+00:00 [production]
02:32 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 22s) [production]
01:44 <catrope@tin> Synchronized php-1.27.0-wmf.2/extensions/Echo: Fix JS error (duration: 00m 18s) [production]
01:44 <catrope@tin> Synchronized php-1.27.0-wmf.1/extensions/Echo: Fix JS error (duration: 00m 17s) [production]
00:04 <catrope@tin> Synchronized php-1.27.0-wmf.2/extensions/Echo: SWAT (duration: 00m 17s) [production]
00:04 <catrope@tin> Synchronized php-1.27.0-wmf.1/extensions/Echo: SWAT (duration: 00m 17s) [production]
2015-10-06 §
23:20 <ebernhardson@tin> Synchronized wmf-config: Revert multicluster config for testwiki (duration: 00m 18s) [production]
23:18 <ebernhardson@tin> Synchronized wmf-config/: Enable multicluster ES on testwiki (duration: 00m 17s) [production]
22:44 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 [production]
22:40 <twentyafterfour@tin> Synchronized php-1.27.0-wmf.2: Deploy https://gerrit.wikimedia.org/r/#/c/244066/ (duration: 01m 40s) [production]
21:36 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.1 [production]
21:15 <twentyafterfour> restarted phd in response to a phabricator setup issue [production]
20:58 <bblack> disabling puppet on caches for VCL testing [production]
20:58 <twentyafterfour@tin> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.27.0-wmf.2 [production]
20:53 <twentyafterfour@tin> Finished scap: sync wmf/1.27.0-wmf.1 (duration: 32m 13s) [production]
20:29 <mutante> service "ishmael" has been removed (T109777) - removed docroot on neon. tarball exists in /root just in case. code is on https://github.com/asher/ishmael [production]
20:20 <twentyafterfour@tin> Started scap: sync wmf/1.27.0-wmf.1 [production]
18:48 <yuvipanda> fixing https://phabricator.wikimedia.org/T109216 on labstore1002 [production]
18:10 <godog> upgrade videoscalers to ffmpeg2theora 0.29.0~git+20150813-2 [production]
15:04 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable Suggestion in af, gl, gu, mk, oc, sh and simplewiki [[gerrit:243919]] (duration: 00m 18s) [production]
11:33 <jynus> performing schema change on db1051 enwiki revision [production]
11:10 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1051 for more maintenance (duration: 00m 17s) [production]
10:45 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool es1051 after maintenance (duration: 00m 17s) [production]
10:41 <jynus> potential extra load on mediawiki recent changes and watchlist on enwiki, please report any slowdown [production]
10:22 <jynus> dropping temp recovered tables from db1051 to prepare for repool [production]
09:50 <_joe_> uploaded a new pybal package for jessie [production]
06:19 <paravoid> eqord is back up [production]
04:24 <paravoid> all waves to eqord down, probably related to RT#9619 [production]
02:34 <l10nupdate@tin> LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-06 02:34:31+00:00 [production]
02:29 <l10nupdate@tin> Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 53s) [production]
2015-10-05 §
23:53 <krenair@tin> Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner/includes/ZeroSpecialPage.php: https://gerrit.wikimedia.org/r/#/c/243833/ (duration: 00m 17s) [production]
23:39 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: rv (duration: 00m 17s) [production]
23:38 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/243728/ (duration: 00m 17s) [production]
23:14 <krenair@tin> Synchronized php-1.27.0-wmf.1/extensions/VisualEditor/modules/ve-mw/ui: https://gerrit.wikimedia.org/r/#/c/243729/ (duration: 00m 17s) [production]
23:05 <krenair@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/242942/ (duration: 00m 17s) [production]
21:16 <yurik@tin> Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Take2: Deploying ZeroBanner 242661+243808 (duration: 00m 17s) [production]
21:00 <yurik@tin> Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Rolling back ZeroBanner 242661 (duration: 00m 18s) [production]
20:55 <yurik@tin> Synchronized php-1.27.0-wmf.1/extensions/ZeroBanner: Deploying ZeroBanner 242661 (duration: 00m 17s) [production]
18:38 <mutante> restarted gitblit [production]
17:44 <gwicke> rolling restart of eqiad restbase nodes done [production]
17:27 <gwicke> rolling restart of restbase cluster to rule out driver issues causing the increased p99 read lacenty [production]
17:19 <robh> analytics1035 pegged out, ssh unresponsive and raid failures, and then fixed itself 5 minutes later [production]