6301-6350 of 10000 results (35ms)
2014-09-12 §
08:06 <_joe_> new pybal conf applied in all of ulsfo [production]
07:39 <_joe_> changing pybal config place; stopping puppet on all loadbalancers [production]
04:27 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Sep 12 04:27:17 UTC 2014 (duration 27m 16s) [production]
03:16 <LocalisationUpdate> completed (1.24wmf21) at 2014-09-12 03:15:57+00:00 [production]
03:08 <mattflaschen> Finished scap: One last CSS fix (wrapping issue for error state) for GettingStarted A/B test (duration: 24m 38s) [production]
02:43 <mattflaschen> Started scap: One last CSS fix (wrapping issue for error state) for GettingStarted A/B test [production]
02:39 <LocalisationUpdate> completed (1.24wmf20) at 2014-09-12 02:39:35+00:00 [production]
01:33 <mattflaschen> Synchronized php-1.24wmf21/extensions/GettingStarted/: CSS tweaks for GettingStarted A/B test (duration: 00m 07s) [production]
01:32 <mattflaschen> Synchronized php-1.24wmf20/extensions/GettingStarted/: CSS tweaks for GettingStarted A/B test (duration: 00m 21s) [production]
01:29 <ori> Synchronized wmf-config/wikitech.php: Ia5b81076e: Update path reference for /srv/mediawiki (duration: 00m 04s) [production]
01:28 <ori> updated /a/common to {{Gerrit|Ia5b81076e}}: Update path reference for /srv/mediawiki [production]
01:19 <ori> manually migrated /u/l/a/common-local to /srv/mediawiki on virt1000 [production]
00:36 <ori> Synchronized php-1.24wmf21/extensions/Wikidata: Update Wikidata to tip of master for I23b7eb54b8e (Bug: 70747) (duration: 00m 08s) [production]
00:12 <esanders> Synchronized php-1.24wmf21/resources/lib/oojs-ui/: (no message) (duration: 00m 03s) [production]
00:12 <esanders> Synchronized php-1.24wmf21/extensions/MultimediaViewer/: (no message) (duration: 00m 07s) [production]
00:00 <esanders> Finished scap: SWAT deploy (duration: 28m 39s) [production]
2014-09-11 §
23:31 <esanders> Started scap: SWAT deploy [production]
23:29 <mattflaschen> Finished scap: Deploy new GettingStarted recommendations A/B test (duration: 99m 34s) [production]
23:15 <esanders> scap failed: LockFailedError Failed to lock /var/lock/scap: [Errno 11] Resource temporarily unavailable (duration: 00m 00s) [production]
23:00 <mutante> restarting icinga-wm for config change [production]
21:49 <mattflaschen> Started scap: Deploy new GettingStarted recommendations A/B test [production]
21:14 <Krinkle> Stopping/starting zuul [production]
21:09 <andrewbogott> restarting zuul on gallium [production]
20:58 <andrewbogott> restarted jenkins, maybe [production]
20:56 <ori> graceful'd apache on mw1053, missed it earlier [production]
20:49 <ori> Synchronized wmf-config/CommonSettings.php: I1f3234746: Revert Scribunto: double the Lua CPU limit on the job runners (duration: 00m 05s) [production]
20:48 <ori> updated /a/common to {{Gerrit|I1f3234746}}: Revert "Scribunto: double the Lua CPU limit on the job runners" [production]
20:43 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 14s) [production]
20:15 <reedy> Synchronized wmf-config/: (no message) (duration: 00m 13s) [production]
20:15 <andrewbogott> syncing virt1000, again in hopes of moving to wmf20 [production]
20:08 <reedy> Synchronized php-1.24wmf21/extensions/Wikidata/: (no message) (duration: 00m 17s) [production]
19:58 <Reedy> Running sync-common on mw1024 [production]
19:52 <Reedy> Running manual sync-common on mw1138 [production]
19:52 <reedy> Synchronized wmf-config/: Fix Zero settings (duration: 00m 15s) [production]
19:49 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.24wmf21 [production]
19:44 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: wikipedias to 1.24wmf20 [production]
19:20 <mutante> graceful'ed apache on mw1143 [production]
19:16 <Reedy> running sync-common on mw1143 [production]
19:10 <reedy> rebuilt wikiversions.cdb and synchronized wikiversions files: (no message) [production]
19:02 <bd808> Restarted elasticsearch on logstash1003 -- Java OOM error in logs and not recovering shards [production]
18:54 <ori> graceful'd all apaches [production]
18:51 <ori> graceful'd apache on mw1047, mw1151, mw1137, mw1146 and mw1076 [production]
18:46 <ori> Synchronized php-1.24wmf19/includes/WebStart.php: (no message) (duration: 00m 06s) [production]
18:45 <ori> Synchronized php-1.24wmf19/includes/profiler/Profiler.php: (no message) (duration: 00m 07s) [production]
18:17 <reedy> Started scap: testwiki to 1.24wmf21 and build l10n cache take 3 [production]
18:15 <reedy> Started scap: testwiki to 1.24wmf21 and build l10n cache [production]
18:08 <reedy> Started scap: testwiki to 1.24wmf21 and build l10n cache [production]
18:02 <manybubbles> raised logging on Elasticsearch cluster temporarily to get more information about merging - a process super important to keeping the index up to date in "real time" [production]
17:20 <ori> updated /a/common to {{Gerrit|I0bda3deab}}: Replace remaining references to /u/l/a/common [production]
17:18 <ori> updated /a/common to {{Gerrit|I37b0a8338}}: Get rid of MULTIVER_CDB_DIR_{APACHE,HOME} [production]