| 2015-10-19
      
      § | 
    
  | 16:48 | <urandom> | restbase deploy complete | [production] | 
            
  | 16:37 | <anomie@tin> | Finished scap: SWAT: Add a change tag to cross-wiki uploads [[gerrit:246701]] (duration: 55m 05s) | [production] | 
            
  | 15:42 | <anomie@tin> | Started scap: SWAT: Add a change tag to cross-wiki uploads [[gerrit:246701]] | [production] | 
            
  | 15:39 | <anomie@tin> | Synchronized php-1.27.0-wmf.2/extensions/Cite: SWAT: Display 'cite_error_references_duplicate_key' next to the affected ref [[gerrit:247255]] (duration: 00m 18s) | [production] | 
            
  | 15:30 | <anomie@tin> | Synchronized php-1.27.0-wmf.3/extensions/Cite: SWAT: Display 'cite_error_references_duplicate_key' next to the affected ref [[gerrit:247256]] (duration: 00m 18s) | [production] | 
            
  | 15:25 | <anomie@tin> | Synchronized php-1.27.0-wmf.2/includes/deferred/LinksDeletionUpdate.php: SWAT: Use specified pageId for LinksDeletionUpdate→DeleteLinksJob [[gerrit:247268]] (duration: 00m 18s) | [production] | 
            
  | 15:24 | <anomie@tin> | Synchronized php-1.27.0-wmf.3/includes/deferred/LinksDeletionUpdate.php: SWAT: Use specified pageId for LinksDeletionUpdate→DeleteLinksJob [[gerrit:247267]] (duration: 00m 17s) | [production] | 
            
  | 15:12 | <urandom> | deploying a4c55e40 to RESTBase | [production] | 
            
  | 15:11 | <joal> | Scheduling icinga downtime for CQL checks on aqs while heavily loading data - joal (me) babysites the jobs - 1 day downtime, will reiterate tomorrow if needed | [production] | 
            
  | 15:09 | <ottomata> | enabling varnish reqstats diamond collector on all upload caches | [production] | 
            
  | 15:09 | <anomie@tin> | Synchronized php-1.27.0-wmf.3/extensions/Flow/includes/Search/Connection.php: SWAT: Backport [[gerrit:246134]] because the thing it fixed suddenly started breaking unit tests, preventing other merges (duration: 00m 18s) | [production] | 
            
  | 15:07 | <anomie@tin> | Synchronized php-1.27.0-wmf.2/extensions/Flow/includes/Search/Connection.php: SWAT: Backport [[gerrit:246134]] because the thing it fixed suddenly started breaking unit tests, preventing other merges (duration: 00m 18s) | [production] | 
            
  | 14:52 | <akosiaris> | disabled puppet on maps-test200{1,2,4}. Debugging cassandra multi-instance setup aftermath. Not to be enabled | [production] | 
            
  | 14:34 | <urandom> | canary deploy (a4c55e40) to restbase1001.eqiad | [production] | 
            
  | 12:47 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-isl-eng_0.1.0~r20599-1 | [production] | 
            
  | 12:22 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-isl_0.1.0-1 | [production] | 
            
  | 06:19 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Mon Oct 19 06:19:09 UTC 2015 (duration 19m 8s) | [production] | 
            
  | 03:04 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-19 03:04:49+00:00 | [production] | 
            
  | 02:59 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 40s) | [production] | 
            
  | 02:36 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-19 02:36:53+00:00 | [production] | 
            
  | 02:32 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 15s) | [production] | 
            
  
    | 2015-10-18
      
      § | 
    
  | 10:04 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-mlt-ara_0.1.0~r57554-1 | [production] | 
            
  | 10:04 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-is-sv_0.1.0~r56030-1 | [production] | 
            
  | 10:04 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-es-ro_0.7.3~r57551-1 | [production] | 
            
  | 10:04 | <akosiaris> | uploaded to apt.wikimedia.org trusty-wikimedia: apertium-es-it_0.1.0~r51165-1 | [production] | 
            
  | 06:11 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Sun Oct 18 06:11:37 UTC 2015 (duration 11m 36s) | [production] | 
            
  | 02:57 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-18 02:57:48+00:00 | [production] | 
            
  | 02:52 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 31s) | [production] | 
            
  | 02:29 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-18 02:29:50+00:00 | [production] | 
            
  | 02:24 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 25s) | [production] | 
            
  
    | 2015-10-17
      
      § | 
    
  | 20:02 | <godog> | powercycle analytics1034, no console no ssh | [production] | 
            
  | 14:05 | <godog> | reboot krypton, unable to ssh and no console (VM) iowait through the roof | [production] | 
            
  | 06:27 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Sat Oct 17 06:27:04 UTC 2015 (duration 27m 3s) | [production] | 
            
  | 03:02 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-17 03:02:58+00:00 | [production] | 
            
  | 02:58 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 14s) | [production] | 
            
  | 02:35 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-17 02:35:14+00:00 | [production] | 
            
  | 02:30 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 09s) | [production] | 
            
  
    | 2015-10-16
      
      § | 
    
  | 20:52 | <hashar> | Restarting Jenkins to remove potential dead locks before the week-end | [production] | 
            
  | 19:29 | <ori> | deleted /var/lib/carbon/whisper/MediaWiki/MediaWiki on graphite1001 & graphite2001 per tgr's request | [production] | 
            
  | 13:18 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: I14ecd0ae87: Turn off UserDailyContribs extension (duration: 00m 18s) | [production] | 
            
  | 06:25 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Fri Oct 16 06:25:56 UTC 2015 (duration 25m 55s) | [production] | 
            
  | 03:11 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.3) at 2015-10-16 03:11:14+00:00 | [production] | 
            
  | 03:06 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.3/cache/l10n: l10nupdate for 1.27.0-wmf.3 (duration: 08m 31s) | [production] | 
            
  | 02:43 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.2) at 2015-10-16 02:43:42+00:00 | [production] | 
            
  | 02:38 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.2/cache/l10n: l10nupdate for 1.27.0-wmf.2 (duration: 08m 38s) | [production] | 
            
  | 02:27 | <jynus> | repairing table and restarting replication on s7 from labsdb1002 | [production] | 
            
  | 02:23 | <jynus> | repairing table and restarting replication on s5 from dbstore1002 (non-production host) | [production] | 
            
  | 01:36 | <Jamesofur> | reset email address for User:INeverCry after identify verification | [production] |