| 2015-11-13
      
      § | 
    
  | 20:14 | <robh> | installing xfp optics into cr1-ulsfo:xe-0/0/2 (spare port) | [production] | 
            
  | 18:04 | <bblack> | added neodymium to salt term in common-infrastructure4 on cr[12]-eqiad | [production] | 
            
  | 17:37 | <csteipp> | applied and reverted patch for T118032 (lots of exceptions on deploy) | [production] | 
            
  | 16:16 | <jynus> | restarting mysql on db2056, db2063 and db2064 for regular upgrade | [production] | 
            
  | 15:16 | <godog> | bootstrap restbase2001-b cassandra instance | [production] | 
            
  | 15:03 | <jynus> | restarting db2058, db2065 for regular mysql upgrade | [production] | 
            
  | 14:43 | <jynus> | restarting db2059, db2066 for regular mysql upgrade | [production] | 
            
  | 11:42 | <jynus> | restarting db2060 mysql for upgrade | [production] | 
            
  | 09:20 | <jynus> | performing table optimization on db1015, expect some lag while depooled | [production] | 
            
  | 08:37 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1035 at 100%, depool db1015 (duration: 01m 31s) | [production] | 
            
  | 06:58 | <_joe_> | trying to manually syncing the ubuntu mirrors, since they are corrupted at the moment | [production] | 
            
  | 02:26 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 05m 21s) | [production] | 
            
  | 01:27 | <YuviPanda> | bounced mw1045 HHVM for ebernhardson | [production] | 
            
  | 01:15 | <catrope@tin> | Finished scap: I totally forgot that the SWAT contained i18n changes (duration: 26m 46s) | [production] | 
            
  | 00:48 | <catrope@tin> | Started scap: I totally forgot that the SWAT contained i18n changes | [production] | 
            
  | 00:27 | <catrope@tin> | Synchronized php-1.27.0-wmf.6/extensions/QuickSurveys: SWAT (duration: 00m 30s) | [production] | 
            
  | 00:24 | <catrope@tin> | Synchronized php-1.27.0-wmf.6/extensions/Flow: SWAT (duration: 00m 32s) | [production] | 
            
  | 00:23 | <catrope@tin> | Synchronized php-1.27.0-wmf.6/extensions/CentralNotice: SWAT (duration: 00m 31s) | [production] | 
            
  | 00:16 | <catrope@tin> | Synchronized wmf-config/CommonSettings.php: Remove hardcoded max upload size for UploadWizard (duration: 00m 30s) | [production] | 
            
  | 00:14 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Turn off language detection user test for CirrusSearch (duration: 00m 30s) | [production] | 
            
  
    | 2015-11-12
      
      § | 
    
  | 23:05 | <bd808@tin> | Synchronized wmf-config/logging.php: Monolog: wrap channel handlers in a WhatFailureGroupHandler (b08aaf4) (duration: 00m 29s) | [production] | 
            
  | 22:46 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: wikipedia wikis to 1.27.0-wmf.6 | [production] | 
            
  | 22:42 | <twentyafterfour@tin> | Synchronized php-1.27.0-wmf.6/extensions/TranslationNotifications/TranslationNotificationJob.php: hotfix T116960 (duration: 00m 30s) | [production] | 
            
  | 21:21 | <krinkle@tin> | Synchronized php-1.27.0-wmf.6/resources/lib/jquery.i18n/src/jquery.i18n.language.js: T118242 - Unbreak IE8 (duration: 00m 30s) | [production] | 
            
  | 21:10 | <chasemp> | reboot analytics1040 it locked up | [production] | 
            
  | 19:05 | <thcipriani@tin> | Synchronized wmf-config/throttle.php: SWAT: Set throttle exception for University of Haifa wiki event [[gerrit:252010]] (duration: 00m 29s) | [production] | 
            
  | 18:21 | <maxsem@tin> | Synchronized portals/: The rest of portals (duration: 00m 31s) | [production] | 
            
  | 17:25 | <subbu> | finished parsoid deploy sha 392e25eb | [production] | 
            
  | 17:02 | <subbu> | starting parsoid deploy | [production] | 
            
  | 16:29 | <thcipriani@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT: Deploy QuickSurveys to English Wikipedia [[gerrit:252606]] (duration: 00m 29s) | [production] | 
            
  | 16:28 | <ostriches> | gerrit: reloading replication plugin to pick up new config | [production] | 
            
  | 16:11 | <andrewbogott> | depooled T118469.  https://phabricator.wikimedia.org/T118469 | [production] | 
            
  | 16:08 | <bd808> | cleaned up stale branch checkouts on mw1041: php-1.26wmf16 php-1.26wmf17 php-1.26wmf18 php-1.26wmf19 php-1.26wmf20 php-1.26wmf21 | [production] | 
            
  | 16:02 | <mobrovac> | restbase end deploy of e5e45d11ad3f | [production] | 
            
  | 15:48 | <mobrovac> | restbase start deploy of e5e45d11ad3f | [production] | 
            
  | 15:46 | <mobrovac> | restbase canary deploy on rb1001 of e5e45d11ad3f | [production] | 
            
  | 15:39 | <jynus> | powercycling mw1041 | [production] | 
            
  | 15:30 | <jynus@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1035 after maintenance (duration: 00m 29s) | [production] | 
            
  | 10:11 | <ori@tin> | Synchronized php-1.27.0-wmf.6/extensions/UniversalLanguageSelector: I9206a79: Only use jQuery.tipsy for undo popover (duration: 00m 31s) | [production] | 
            
  | 09:53 | <jynus> | rebooting/upgrading/restarting mariadb on db1035 after maintenance finished | [production] | 
            
  | 09:51 | <jynus> | uploading new mariadb package linked to openssl instead of yassl | [production] | 
            
  | 09:44 | <ori@tin> | Synchronized php-1.27.0-wmf.5/extensions/UniversalLanguageSelector: I9206a79: Only use jQuery.tipsy for undo popover (duration: 01m 15s) | [production] | 
            
  | 09:39 | <moritzm> | corrected apt sources on db2057, db2058, db2062, db2065, db2066, db2067, db2068, db2069 | [production] | 
            
  | 08:42 | <moritzm> | restarted salt-master on palladium | [production] | 
            
  | 07:35 | <_joe_> | restarting pybal on lvs1004 | [production] | 
            
  | 02:23 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.5/cache/l10n: l10nupdate for 1.27.0-wmf.5 (duration: 06m 56s) | [production] | 
            
  | 01:02 | <gwicke> | restbase: finished full deploy of restbase-deploy ce4abe784 | [production] | 
            
  | 00:50 | <gwicke> | restbase: starting full deploy of restbase-deploy ce4abe784 | [production] | 
            
  | 00:37 | <gwicke> | restbase: canary deploy of restbase-deploy ce4abe784 on restbase1001 | [production] | 
            
  | 00:32 | <catrope@tin> | Synchronized wmf-config/InitialiseSettings.php: Fix typo in QuickSurveys config (duration: 00m 31s) | [production] |