501-550 of 10000 results (22ms)
2015-01-26 §
02:23 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-26 02:23:10+00:00 [production]
02:23 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 03s) [production]
02:15 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-26 02:14:49+00:00 [production]
02:14 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
2015-01-25 §
20:50 <ori> depooled mw1118 while investigating T85428 [production]
18:55 <bd808> high rate of nutcracker "SYSTEM ERROR" errors on mw1118 [production]
18:44 <bd808> trimmed Logstash redis input queues to 0 events; dropped ~4M backlogged events [production]
04:14 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jan 25 04:14:33 UTC 2015 (duration 14m 32s) [production]
02:23 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-25 02:22:58+00:00 [production]
02:23 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 02s) [production]
02:10 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-25 02:10:30+00:00 [production]
02:10 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
2015-01-24 §
22:40 <bd808> Emptied logstash redis lists on all 3 hosts [production]
22:27 <bd808> Full restart of logstash elasticsearch cluster [production]
06:27 <paravoid> mass-restarting hhvm across the cluster [production]
06:22 <faidon> Synchronized wmf-config: touched config (duration: 00m 07s) [production]
06:04 <faidon> Synchronized wmf-config/StartProfiler.php: fix for T87497/r186578 (duration: 00m 06s) [production]
04:52 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jan 24 04:52:42 UTC 2015 (duration 52m 41s) [production]
02:30 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-24 02:30:10+00:00 [production]
02:30 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 02s) [production]
02:17 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-24 02:17:08+00:00 [production]
02:17 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
01:06 <hashar> restarting Jenkins (deadlock on deployment-bastion slave) [production]
00:50 <reedy> Synchronized wmf-config/: Kill wmgVectorBetaPersonalBar (duration: 00m 08s) [production]
00:23 <YuviPanda> begin re-imaging osmium [production]
2015-01-23 §
23:53 <reedy> Synchronized wmf-config/: More config updates (duration: 00m 06s) [production]
23:43 <reedy> Synchronized wmf-config/: Config updates (duration: 00m 06s) [production]
23:34 <godog> halting lsearchd machines [production]
23:23 <_joe_> repooling 10 appservers depooled for no apparent reason, and no entry in the SAL [production]
22:57 <ori> Synchronized wmf-config/CommonSettings.php: I50931db37: Route all counter stats to tungsten:3811 (duration: 00m 07s) [production]
22:57 <Reedy> updateCollation.php for plwikisource complete [production]
22:52 <godog> restarting graphite on tungsten, webapp stuck and no graphs [production]
22:49 <Reedy> running mwscript updateCollation.php --wiki=plwikisource --previous-collation=uppercase in screen as reedy on tin [production]
22:48 <reedy> Synchronized wmf-config/InitialiseSettings.php: plwikisource collation update (duration: 00m 06s) [production]
22:41 <reedy> Synchronized 404.html: updates (duration: 00m 06s) [production]
22:41 <reedy> Synchronized docroot and w: Update docroot files (duration: 00m 05s) [production]
22:38 <reedy> Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 05s) [production]
21:55 <godog> removed puppet stored config for search* and searchidx* [production]
21:34 <_joe_> installing a new hhvm package on the canary appservers [production]
21:21 <_joe_> uploaded new hhvm package to apt.w.o [production]
20:30 <rmoen> Synchronized php-1.25wmf15/extensions/MobileFrontend/: updating mobilefrontend credits (duration: 00m 06s) [production]
20:09 <csteipp> deployed patch for T64685 [production]
19:44 <ejegg> updated payments from 46bd1611c56d6e31594d01aa345c35dd45dcf676 to 4743b32c9091d6f2169bea3173e75aa5d2f36eb7 [production]
19:03 <ebernhardson> Synchronized php-1.25wmf14/extensions/Flow: Bump flow submodule in 1.25wmf14 (duration: 00m 07s) [production]
19:02 <ebernhardson> Synchronized php-1.25wmf15/extensions/Flow/: Bump flow submodule in 1.25wmf15 (duration: 00m 08s) [production]
17:59 <mutante> apt-get clean, free some diskspace on antimony [production]
17:17 <bd808> logstash1002 elasticsearch rejoined cluster after restart [production]
17:14 <bd808> logstash elasticsearch cluster split brained; logstash1002 thinks it is a lone master [production]
07:20 <ori> restarted puppetmaster and apache2 on palladium. [production]
04:03 <LocalisationUpdate> ResourceLoader cache refresh completed at Fri Jan 23 04:03:45 UTC 2015 (duration 3m 44s) [production]