| 
      
        2015-07-17
      
      §
     | 
  
    
  | 21:51 | 
  <ejegg> | 
  updated civicrm from 0acac037ce0c9a64e94a475463deb2d47e84193a to 78de1b9b74934984af3099afe9192fa53011bdaa | 
  [production] | 
            
  | 20:53 | 
  <matt_flaschen> | 
  Manually fixed issue in mediawikiwiki LQT thread table with rename of Ecliptica to Entropy. https://phabricator.wikimedia.org/T106122#1461380 | 
  [production] | 
            
  | 20:03 | 
  <hashar> | 
  stopping Zuul to get rid of a faulty registered function "build:Global-Dev Dashboard Data". Job is gone already. | 
  [production] | 
            
  | 17:50 | 
  <ejegg> | 
  updated civicrm from fa724dd2e2e69545d81015c943cb7f52cf6de8e1 to 0acac037ce0c9a64e94a475463deb2d47e84193a | 
  [production] | 
            
  | 16:49 | 
  <gwicke> | 
  restarted restbase on restbase1001 | 
  [production] | 
            
  | 15:04 | 
  <gwicke> | 
  restarted RB thinner scripts, see https://phabricator.wikimedia.org/T105706 | 
  [production] | 
            
  | 14:10 | 
  <urandom> | 
  restart restbase service on restbase1006 | 
  [production] | 
            
  | 14:07 | 
  <urandom> | 
  restart restbase service on restbase1003 | 
  [production] | 
            
  | 14:05 | 
  <urandom> | 
  restart restbase service on restbase1002 | 
  [production] | 
            
  | 13:56 | 
  <godog> | 
  apache2ctl graceful on fluorine antimony argon caesium helium | 
  [production] | 
            
  | 13:43 | 
  <godog> | 
  apache2ctl graceful on netmon1001 | 
  [production] | 
            
  | 11:24 | 
  <hashar> | 
  rebooted labnodepool1001.eqiad.wmnet . Accidentally deleted the whole /dev which freeze everything :( | 
  [production] | 
            
  | 10:21 | 
  <_joe_> | 
  repooling mw1158 | 
  [production] | 
            
  | 09:08 | 
  <_joe_> | 
  depooling mw1158, repooling mw1156,7 | 
  [production] | 
            
  | 07:51 | 
  <_joe_> | 
  depooled mw1156,7 for reimaging | 
  [production] | 
            
  | 04:54 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Fri Jul 17 04:53:56 UTC 2015 (duration 53m 55s) | 
  [production] | 
            
  | 03:31 | 
  <springle> | 
  Synchronized wmf-config/db-eqiad.php: repool db1030 (duration: 00m 12s) | 
  [production] | 
            
  | 02:30 | 
  <LocalisationUpdate> | 
  completed (1.26wmf14) at 2015-07-17 02:30:03+00:00 | 
  [production] | 
            
  | 02:26 | 
  <l10nupdate> | 
  Synchronized php-1.26wmf14/cache/l10n: (no message) (duration: 05m 55s) | 
  [production] | 
            
  | 02:07 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Fri Jul 17 02:07:22 UTC 2015 (duration 7m 20s) | 
  [production] | 
            
  | 02:03 | 
  <LocalisationUpdate> | 
  failed (1.26wmf14) at 2015-07-17 02:03:12+00:00 | 
  [production] | 
            
  | 01:30 | 
  <mutante> | 
  git pull origin on strontium | 
  [production] | 
            
  
    | 
      
        2015-07-16
      
      §
     | 
  
    
  | 21:27 | 
  <ori> | 
  bounced nutcracker on mw1139 as well. hashar noticed flood of errors from these hosts on https://logstash.wikimedia.org/#/dashboard/elasticsearch/mediawiki-errors . lack of monitoring / alerts is troubling. | 
  [production] | 
            
  | 21:26 | 
  <ori> | 
  bounced nutcracker on mw1128 and mw1134 | 
  [production] | 
            
  | 20:50 | 
  <mutante> | 
  iegreview tool - short maintenance downtime | 
  [production] | 
            
  | 19:39 | 
  <YuviPanda> | 
  imported aspell-id from ubuntu to jessie-wikimedia - needed by ores, simple package that I am not sure why it is not in jessie | 
  [production] | 
            
  | 19:20 | 
  <twentyafterfour> | 
  Synchronized php-1.26wmf14/includes/db/LoadMonitor.php: Deploying Hotfix for T105373 (duration: 00m 13s) | 
  [production] | 
            
  | 18:40 | 
  <twentyafterfour> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: all wikis to 1.26wmf14 | 
  [production] | 
            
  | 18:26 | 
  <ejegg> | 
  changed batch size from 250 to 1 in RGC jenkins job | 
  [production] | 
            
  | 18:22 | 
  <ejegg> | 
  updated civicrm from 24e0fc854433ea4982e94a0fd2f8bdad8f8dcad7 to fa724dd2e2e69545d81015c943cb7f52cf6de8e1 | 
  [production] | 
            
  | 16:56 | 
  <Jeff_Green> | 
  authdns update to rename lutetium.wm.o | 
  [production] | 
            
  | 16:08 | 
  <hashar_> | 
  kept nodepool stopped on labnodepool1001.eqiad.wmnet because it spams the cron log | 
  [production] | 
            
  | 15:57 | 
  <demon> | 
  Synchronized multiversion/MWMultiVersion.php: prod no-op, beta change (duration: 00m 13s) | 
  [production] | 
            
  | 15:54 | 
  <krenair> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/224975/ (duration: 00m 12s) | 
  [production] | 
            
  | 15:27 | 
  <thcipriani> | 
  Synchronized php-1.26wmf14/extensions/Math/MathMathML.php: SWAT: Fix: Undefined variable passed hook [[gerrit:225058]] (duration: 00m 12s) | 
  [production] | 
            
  | 15:03 | 
  <ejegg> | 
  updated payments from 4ca95d55a9745c05ccfbb16ee6f23a6f75328824 to ebb1a9e52172a4793cf5feb33220b4d7edfcad70 | 
  [production] |