| 
      
        2015-11-14
      
      §
     | 
  
    
  | 22:49 | 
  <reedy@tin> | 
  Synchronized php-1.26wmf24/: purge l10n cache... test if deletes are propogated (duration: 01m 12s) | 
  [production] | 
            
  | 22:43 | 
  <Reedy> | 
  deleted more old l10ncaches from tin staging 1.27 wmf1-4 | 
  [production] | 
            
  | 22:37 | 
  <reedy@tin> | 
  Synchronized phpunit.xml: (no message) (duration: 00m 30s) | 
  [production] | 
            
  | 22:26 | 
  <reedy@tin> | 
  Synchronized php-1.26wmf24: remove old localisation cache (duration: 01m 38s) | 
  [production] | 
            
  | 22:22 | 
  <reedy@tin> | 
  Synchronized php-1.26wmf23: remove old localisation cache (duration: 01m 40s) | 
  [production] | 
            
  | 22:09 | 
  <reedy@tin> | 
  Synchronized phpunit.xml: noop test (duration: 01m 03s) | 
  [production] | 
            
  | 20:51 | 
  <Reedy> | 
  Deleted php-1.26wmf11, php-1.26wmf12 and php-1.26wmf13 from mira /srv/mediawiki-staging | 
  [production] | 
            
  | 20:40 | 
  <reedy@tin> | 
  Synchronized php-1.27.0-wmf.6/extensions/BounceHandler/: Email header logging on unsubscribe (duration: 00m 53s) | 
  [production] | 
            
  | 02:20 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 05m 58s) | 
  [production] | 
            
  | 01:58 | 
  <ori> | 
  restarted HHVM on all app servers | 
  [production] | 
            
  
    | 
      
        2015-11-13
      
      §
     | 
  
    
  | 23:30 | 
  <ori@tin> | 
  Synchronized rpc/RunJobs.php: I5e15ec9fb: Disable ChronologyProtector for rpc/RunJobs.php (duration: 00m 30s) | 
  [production] | 
            
  | 21:23 | 
  <maxsem@tin> | 
  Synchronized portals/: Did scap errors go away? (duration: 00m 30s) | 
  [production] | 
            
  | 21:17 | 
  <YuviPanda> | 
  bounced etherpad again | 
  [production] | 
            
  | 20:39 | 
  <maxsem@tin> | 
  Synchronized portals/: Did scap errors go away? (duration: 00m 29s) | 
  [production] | 
            
  | 20:38 | 
  <maxsem@tin> | 
  Synchronized portals/: Did scap errors go away? (duration: 00m 29s) | 
  [production] | 
            
  | 20:35 | 
  <maxsem@tin> | 
  Synchronized portals/: Did scap errors go away? (duration: 00m 30s) | 
  [production] | 
            
  | 20:30 | 
  <maxsem@tin> | 
  Synchronized portals/: Bump to master (duration: 00m 39s) | 
  [production] | 
            
  | 20:19 | 
  <robh> | 
  cr2-xe-1/3/0 optic install completed (detects fine) | 
  [production] | 
            
  | 20:18 | 
  <robh> | 
  cr1-ulsfo:xe-0/0/2  optic install completed (detects fine) | 
  [production] | 
            
  | 20:17 | 
  <robh> | 
  cr1-ulsfo:xe-0/0/2 (spare port) xfp optic detects fine, now installing other spare into cr2-xe-1/3/0 | 
  [production] | 
            
  | 20:14 | 
  <robh> | 
  installing xfp optics into cr1-ulsfo:xe-0/0/2 (spare port) | 
  [production] | 
            
  | 18:04 | 
  <bblack> | 
  added neodymium to salt term in common-infrastructure4 on cr[12]-eqiad | 
  [production] | 
            
  | 17:37 | 
  <csteipp> | 
  applied and reverted patch for T118032 (lots of exceptions on deploy) | 
  [production] | 
            
  | 16:16 | 
  <jynus> | 
  restarting mysql on db2056, db2063 and db2064 for regular upgrade | 
  [production] | 
            
  | 15:16 | 
  <godog> | 
  bootstrap restbase2001-b cassandra instance | 
  [production] | 
            
  | 15:03 | 
  <jynus> | 
  restarting db2058, db2065 for regular mysql upgrade | 
  [production] | 
            
  | 14:43 | 
  <jynus> | 
  restarting db2059, db2066 for regular mysql upgrade | 
  [production] | 
            
  | 11:42 | 
  <jynus> | 
  restarting db2060 mysql for upgrade | 
  [production] | 
            
  | 09:20 | 
  <jynus> | 
  performing table optimization on db1015, expect some lag while depooled | 
  [production] | 
            
  | 08:37 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1035 at 100%, depool db1015 (duration: 01m 31s) | 
  [production] | 
            
  | 06:58 | 
  <_joe_> | 
  trying to manually syncing the ubuntu mirrors, since they are corrupted at the moment | 
  [production] | 
            
  | 02:26 | 
  <l10nupdate@tin> | 
  Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 05m 21s) | 
  [production] | 
            
  | 01:27 | 
  <YuviPanda> | 
  bounced mw1045 HHVM for ebernhardson | 
  [production] | 
            
  | 01:15 | 
  <catrope@tin> | 
  Finished scap: I totally forgot that the SWAT contained i18n changes (duration: 26m 46s) | 
  [production] | 
            
  | 00:48 | 
  <catrope@tin> | 
  Started scap: I totally forgot that the SWAT contained i18n changes | 
  [production] | 
            
  | 00:27 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.6/extensions/QuickSurveys: SWAT (duration: 00m 30s) | 
  [production] | 
            
  | 00:24 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.6/extensions/Flow: SWAT (duration: 00m 32s) | 
  [production] | 
            
  | 00:23 | 
  <catrope@tin> | 
  Synchronized php-1.27.0-wmf.6/extensions/CentralNotice: SWAT (duration: 00m 31s) | 
  [production] | 
            
  | 00:16 | 
  <catrope@tin> | 
  Synchronized wmf-config/CommonSettings.php: Remove hardcoded max upload size for UploadWizard (duration: 00m 30s) | 
  [production] | 
            
  | 00:14 | 
  <catrope@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Turn off language detection user test for CirrusSearch (duration: 00m 30s) | 
  [production] | 
            
  
    | 
      
        2015-11-12
      
      §
     | 
  
    
  | 23:05 | 
  <bd808@tin> | 
  Synchronized wmf-config/logging.php: Monolog: wrap channel handlers in a WhatFailureGroupHandler (b08aaf4) (duration: 00m 29s) | 
  [production] | 
            
  | 22:46 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.6 | 
  [production] | 
            
  | 22:42 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.27.0-wmf.6/extensions/TranslationNotifications/TranslationNotificationJob.php: hotfix T116960 (duration: 00m 30s) | 
  [production] | 
            
  | 21:21 | 
  <krinkle@tin> | 
  Synchronized php-1.27.0-wmf.6/resources/lib/jquery.i18n/src/jquery.i18n.language.js: T118242 - Unbreak IE8 (duration: 00m 30s) | 
  [production] | 
            
  | 21:10 | 
  <chasemp> | 
  reboot analytics1040 it locked up | 
  [production] | 
            
  | 19:05 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/throttle.php: SWAT: Set throttle exception for University of Haifa wiki event [[gerrit:252010]] (duration: 00m 29s) | 
  [production] | 
            
  | 18:21 | 
  <maxsem@tin> | 
  Synchronized portals/: The rest of portals (duration: 00m 31s) | 
  [production] | 
            
  | 17:25 | 
  <subbu> | 
  finished parsoid deploy sha 392e25eb | 
  [production] | 
            
  | 17:02 | 
  <subbu> | 
  starting parsoid deploy | 
  [production] | 
            
  | 16:29 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Deploy QuickSurveys to English Wikipedia [[gerrit:252606]] (duration: 00m 29s) | 
  [production] |