| 2015-07-17
      
      § | 
    
  | 10:21 | <_joe_> | repooling mw1158 | [production] | 
            
  | 09:08 | <_joe_> | depooling mw1158, repooling mw1156,7 | [production] | 
            
  | 07:51 | <_joe_> | depooled mw1156,7 for reimaging | [production] | 
            
  | 04:54 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Jul 17 04:53:56 UTC 2015 (duration 53m 55s) | [production] | 
            
  | 03:31 | <springle> | Synchronized wmf-config/db-eqiad.php: repool db1030 (duration: 00m 12s) | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.26wmf14) at 2015-07-17 02:30:03+00:00 | [production] | 
            
  | 02:26 | <l10nupdate> | Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 05m 55s) | [production] | 
            
  | 02:07 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Jul 17 02:07:22 UTC 2015 (duration 7m 20s) | [production] | 
            
  | 02:03 | <LocalisationUpdate> | failed (1.26wmf14) at 2015-07-17 02:03:12+00:00 | [production] | 
            
  | 01:30 | <mutante> | git pull origin on strontium | [production] | 
            
  
    | 2015-07-16
      
      § | 
    
  | 21:27 | <ori> | bounced nutcracker on mw1139 as well. hashar noticed flood of errors from these hosts on https://logstash.wikimedia.org/#/dashboard/elasticsearch/mediawiki-errors . lack of monitoring / alerts is troubling. | [production] | 
            
  | 21:26 | <ori> | bounced nutcracker on mw1128 and mw1134 | [production] | 
            
  | 20:50 | <mutante> | iegreview tool - short maintenance downtime | [production] | 
            
  | 19:39 | <YuviPanda> | imported aspell-id from ubuntu to jessie-wikimedia - needed by ores, simple package that I am not sure why it is not in jessie | [production] | 
            
  | 19:20 | <twentyafterfour> | Synchronized php-1.26wmf14/includes/db/LoadMonitor.php: Deploying Hotfix for T105373 (duration: 00m 13s) | [production] | 
            
  | 18:40 | <twentyafterfour> | rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf14 | [production] | 
            
  | 18:26 | <ejegg> | changed batch size from 250 to 1 in RGC jenkins job | [production] | 
            
  | 18:22 | <ejegg> | updated civicrm from 24e0fc854433ea4982e94a0fd2f8bdad8f8dcad7 to fa724dd2e2e69545d81015c943cb7f52cf6de8e1 | [production] | 
            
  | 16:56 | <Jeff_Green> | authdns update to rename lutetium.wm.o | [production] | 
            
  | 16:08 | <hashar_> | kept nodepool stopped on labnodepool1001.eqiad.wmnet because it spams the cron log | [production] | 
            
  | 15:57 | <demon> | Synchronized multiversion/MWMultiVersion.php: prod no-op, beta change (duration: 00m 13s) | [production] | 
            
  | 15:54 | <krenair> | Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/224975/ (duration: 00m 12s) | [production] | 
            
  | 15:27 | <thcipriani> | Synchronized php-1.26wmf14/extensions/Math/MathMathML.php: SWAT: Fix: Undefined variable passed hook [[gerrit:225058]] (duration: 00m 12s) | [production] | 
            
  | 15:03 | <ejegg> | updated payments from 4ca95d55a9745c05ccfbb16ee6f23a6f75328824 to ebb1a9e52172a4793cf5feb33220b4d7edfcad70 | [production] | 
            
  | 12:21 | <dcausse> | es1.6 upgrade: all done | [production] | 
            
  | 11:32 | <dcausse> | restarted gmond on elastic1024 | [production] | 
            
  | 11:06 | <mobrovac> | citoid deploying ff90869 | [production] | 
            
  | 10:56 | <dcausse> | es1.6 upgrade: upgrade elastic1031 | [production] | 
            
  | 10:25 | <mobrovac> | citoid rolled back to ffbaf6d | [production] | 
            
  | 10:10 | <mobrovac> | citoid deploying 5aeb0fc | [production] | 
            
  | 10:05 | <dcausse> | es1.6 upgrade: upgrade elastic1030 | [production] | 
            
  | 09:38 | <dcausse> | es1.6 upgrade: upgrade elastic1029 | [production] | 
            
  | 08:42 | <dcausse> | es1.6 upgrade: upgrade elastic1028 | [production] | 
            
  | 07:31 | <dcausse> | es1.6 upgrade: upgrade elastic1027 | [production] | 
            
  | 07:22 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Jul 16 07:22:49 UTC 2015 (duration 22m 48s) | [production] | 
            
  | 05:53 | <dcausse> | es1.6 upgrade: upgrade elastic1026 | [production] | 
            
  | 05:31 | <krenair> | Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 12s) | [production] | 
            
  | 05:24 | <krenair> | Synchronized php-1.26wmf14/extensions/WikimediaMaintenance/dumpInterwiki.php: https://gerrit.wikimedia.org/r/#/c/225008/ (duration: 00m 13s) | [production] | 
            
  | 04:38 | <krenair> | Synchronized php-1.26wmf13/extensions/WikimediaMaintenance/dumpInterwiki.php: https://gerrit.wikimedia.org/r/#/c/225006/ (duration: 00m 13s) | [production] | 
            
  | 03:54 | <manybubbles> | es1.6 upgrade: upgrade elastic1025 | [production] | 
            
  | 03:19 | <LocalisationUpdate> | completed (1.26wmf14) at 2015-07-16 03:19:37+00:00 | [production] | 
            
  | 03:13 | <l10nupdate> | Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 10m 23s) | [production] | 
            
  | 02:46 | <LocalisationUpdate> | completed (1.26wmf13) at 2015-07-16 02:46:03+00:00 | [production] | 
            
  | 02:43 | <manybubbles> | es1.6 upgrade: upgrade elastic1024 | [production] | 
            
  | 02:39 | <l10nupdate> | Synchronized php-1.26wmf13/cache/l10n: (no message) (duration: 10m 50s) | [production] | 
            
  | 02:07 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Jul 16 02:07:55 UTC 2015 (duration 7m 54s) | [production] | 
            
  | 02:03 | <LocalisationUpdate> | failed (1.26wmf14) at 2015-07-16 02:03:31+00:00 | [production] | 
            
  | 02:03 | <LocalisationUpdate> | failed (1.26wmf13) at 2015-07-16 02:03:30+00:00 | [production] | 
            
  | 01:41 | <krenair> | Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/214981/ (duration: 00m 12s) | [production] | 
            
  | 01:22 | <manybubbles> | es1.6 upgrade: upgrade elastic1023 | [production] |