301-350 of 10000 results (23ms)
2015-01-27 §
17:22 <akosiaris> rebooting sca1001, sca1002, chromium, oxygen [production]
17:21 <marktraceur> Synchronized php-1.25wmf14/extensions/GWToolset/: [SWAT] [wmf14] GWToolset HHVM fixes (duration: 00m 06s) [production]
17:11 <marktraceur> Synchronized php-1.25wmf14/extensions/GWToolset/includes/: [SWAT] [wmf14] GWToolset HHVM fixes (duration: 00m 07s) [production]
17:08 <marktraceur> Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Rename portal namespace in kowiki (duration: 00m 05s) [production]
16:54 <marktraceur> Synchronized php-1.25wmf15/extensions/GWToolset/includes/: [SWAT] [wmf15] GWToolset HHVM fixes (duration: 00m 06s) [production]
04:08 <LocalisationUpdate> ResourceLoader cache refresh completed at Tue Jan 27 04:08:16 UTC 2015 (duration 8m 15s) [production]
02:19 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-27 02:19:11+00:00 [production]
02:19 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 03s) [production]
02:11 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-27 02:10:49+00:00 [production]
02:10 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
00:58 <reedy> Synchronized wmf-config/: Noop for citoid for beta (duration: 00m 05s) [production]
00:50 <reedy> Synchronized wmf-config/: Noop for bouncehandler for beta (duration: 00m 06s) [production]
2015-01-26 §
23:57 <_joe_> depooling mw1018 for testing with user changing [production]
20:00 <akosiaris> restarted apache on palladium/strontium, cleared the, created on Jan 23, pid files from puppetmaster [production]
19:59 <_joe_> restarted apache on palladium [production]
19:31 <YuviPanda> restarted keystone on virt1000, ^d couldn’t log in [production]
19:15 <reedy> Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 06s) [production]
04:08 <LocalisationUpdate> ResourceLoader cache refresh completed at Mon Jan 26 04:08:01 UTC 2015 (duration 8m 0s) [production]
02:23 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-26 02:23:10+00:00 [production]
02:23 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 03s) [production]
02:15 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-26 02:14:49+00:00 [production]
02:14 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
2015-01-25 §
20:50 <ori> depooled mw1118 while investigating T85428 [production]
18:55 <bd808> high rate of nutcracker "SYSTEM ERROR" errors on mw1118 [production]
18:44 <bd808> trimmed Logstash redis input queues to 0 events; dropped ~4M backlogged events [production]
04:14 <LocalisationUpdate> ResourceLoader cache refresh completed at Sun Jan 25 04:14:33 UTC 2015 (duration 14m 32s) [production]
02:23 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-25 02:22:58+00:00 [production]
02:23 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 02s) [production]
02:10 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-25 02:10:30+00:00 [production]
02:10 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
2015-01-24 §
22:40 <bd808> Emptied logstash redis lists on all 3 hosts [production]
22:27 <bd808> Full restart of logstash elasticsearch cluster [production]
06:27 <paravoid> mass-restarting hhvm across the cluster [production]
06:22 <faidon> Synchronized wmf-config: touched config (duration: 00m 07s) [production]
06:04 <faidon> Synchronized wmf-config/StartProfiler.php: fix for T87497/r186578 (duration: 00m 06s) [production]
04:52 <LocalisationUpdate> ResourceLoader cache refresh completed at Sat Jan 24 04:52:42 UTC 2015 (duration 52m 41s) [production]
02:30 <LocalisationUpdate> completed (1.25wmf15) at 2015-01-24 02:30:10+00:00 [production]
02:30 <l10nupdate> Synchronized php-1.25wmf15/cache/l10n: (no message) (duration: 00m 02s) [production]
02:17 <LocalisationUpdate> completed (1.25wmf14) at 2015-01-24 02:17:08+00:00 [production]
02:17 <l10nupdate> Synchronized php-1.25wmf14/cache/l10n: (no message) (duration: 00m 02s) [production]
01:06 <hashar> restarting Jenkins (deadlock on deployment-bastion slave) [production]
00:50 <reedy> Synchronized wmf-config/: Kill wmgVectorBetaPersonalBar (duration: 00m 08s) [production]
00:23 <YuviPanda> begin re-imaging osmium [production]
2015-01-23 §
23:53 <reedy> Synchronized wmf-config/: More config updates (duration: 00m 06s) [production]
23:43 <reedy> Synchronized wmf-config/: Config updates (duration: 00m 06s) [production]
23:34 <godog> halting lsearchd machines [production]
23:23 <_joe_> repooling 10 appservers depooled for no apparent reason, and no entry in the SAL [production]
22:57 <ori> Synchronized wmf-config/CommonSettings.php: I50931db37: Route all counter stats to tungsten:3811 (duration: 00m 07s) [production]
22:57 <Reedy> updateCollation.php for plwikisource complete [production]
22:52 <godog> restarting graphite on tungsten, webapp stuck and no graphs [production]