| 
      
        2016-02-04
      
      §
     | 
  
    
  | 19:54 | 
  <demon@mira> | 
  Synchronized private/PrivateSettings.php: (no message) (duration: 02m 05s) | 
  [production] | 
            
  | 19:43 | 
  <ottomata1> | 
  rebooting kafka1012 | 
  [production] | 
            
  | 19:32 | 
  <demon@mira> | 
  Synchronized wmf-config/InitialiseSettings.php: T125850 (duration: 02m 11s) | 
  [production] | 
            
  | 19:00 | 
  <demon@mira> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: prod no op for completeness (duration: 03m 02s) | 
  [production] | 
            
  | 18:49 | 
  <demon@mira> | 
  Synchronized wmf-config/: removing old mwblocker.log (duration: 02m 07s) | 
  [production] | 
            
  | 18:45 | 
  <demon@mira> | 
  Synchronized private/mwblocker.log: (no message) (duration: 02m 10s) | 
  [production] | 
            
  | 18:40 | 
  <yurik> | 
  deployed and reenabled tilerator & tileratorui | 
  [production] | 
            
  | 17:30 | 
  <hoo@mira> | 
  Synchronized php-1.27.0-wmf.12/extensions/Wikidata: Fix editing terms in languages other than the interface language via the term box (duration: 02m 18s) | 
  [production] | 
            
  | 17:29 | 
  <hoo> | 
  (Re)started wdqs-updater on wdqs1001, but seems it doesn't work | 
  [production] | 
            
  | 16:53 | 
  <twentyafterfour> | 
  restarted phd to synchronize settings with phabricator | 
  [production] | 
            
  | 16:52 | 
  <twentyafterfour> | 
  restarted apache2 on iridium so that phabricator recognizes sprint.phragile-uri | 
  [production] | 
            
  | 16:45 | 
  <thcipriani@mira> | 
  Synchronized php-1.27.0-wmf.12/includes/media/Bitmap.php: SWAT: BitmapHandler: Implement validateParam() [[gerrit:268407]] (duration: 02m 08s) | 
  [production] | 
            
  | 16:07 | 
  <thcipriani@mira> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: Enable confirmed group at nowiki [[gerrit:267804]] (duration: 02m 15s) | 
  [production] | 
            
  | 15:53 | 
  <urandom> | 
  rolling restbase restart complete | 
  [production] | 
            
  | 15:47 | 
  <urandom> | 
  restbase cluster puppet run complete; performing rolling restart of restbase (applying https://gerrit.wikimedia.org/r/#/c/266297/) | 
  [production] | 
            
  | 15:44 | 
  <moritzm> | 
  rebooting db203[678] for kernel update | 
  [production] | 
            
  | 15:35 | 
  <urandom> | 
  forcing puppet run on restbase cluster (config deploy) | 
  [production] | 
            
  | 15:34 | 
  <urandom> | 
  reenabling puppet on restbase cluster (continue config deploy) | 
  [production] | 
            
  | 15:18 | 
  <urandom> | 
  restarting restbase on restbase1001.eqiad.wmnet (config deploy) | 
  [production] | 
            
  | 15:15 | 
  <urandom> | 
  re-enabling puppet and forcing run on restbase1001.eqiad.wmnet (canary config deploy) | 
  [production] | 
            
  | 15:11 | 
  <_joe_> | 
  restarting pybal on lvs200{3,6}  | 
  [production] | 
            
  | 15:08 | 
  <urandom> | 
  disabling puppet on restbase cluster in preparation for configuration deploy (https://gerrit.wikimedia.org/r/#/c/266297/) | 
  [production] | 
            
  | 15:07 | 
  <moritzm> | 
  rebooting oxygen for kernel update | 
  [production] | 
            
  | 14:58 | 
  <ottomata> | 
  stopping eventlogging to reboot eventlog1001 for kernel update | 
  [production] | 
            
  | 14:41 | 
  <moritzm> | 
  rebooting db203[45] for kernel update | 
  [production] | 
            
  | 14:09 | 
  <hoo> | 
  Restarted blazegraph on wdqs1001 | 
  [production] | 
            
  | 13:56 | 
  <godog> | 
  powercycle ms-be2020 | 
  [production] | 
            
  | 13:39 | 
  <moritzm> | 
  continue rolling reboot of maps cluster for kernel update (2002-2004) | 
  [production] | 
            
  | 12:21 | 
  <jynus> | 
  starting mysql at db2009 | 
  [production] | 
            
  | 12:08 | 
  <moritzm> | 
  rebooting db2001 to db2019 for kernel update | 
  [production] | 
            
  | 11:44 | 
  <jynus> | 
  dropping echo_* tables from labs | 
  [production] | 
            
  | 11:18 | 
  <dcausse> | 
  elastic codfw: resuming writes and setting cluster.routing.allocation.balance.threshold back to default (1%) | 
  [production] | 
            
  | 10:35 | 
  <dcausse> | 
  elastic codfw: freezing writes and setting cluster.routing.allocation.balance.threshold to 100% (fast recovery test) | 
  [production] | 
            
  | 10:34 | 
  <hashar@mira> | 
  Synchronized php-1.27.0-wmf.12/.gitmodules: Set branch in .gitmodules for extensions/Wikidata https://gerrit.wikimedia.org/r/#/c/268218/ (duration: 02m 08s) | 
  [production] | 
            
  | 10:16 | 
  <moritzm> | 
  rolling reboot of maps cluster for kernel update | 
  [production] | 
            
  | 10:14 | 
  <jynus> | 
  testing new replication filters from production's testwiki | 
  [production] | 
            
  | 10:13 | 
  <elukey> | 
  running smartctl -t long on kafka1012 (kafka not running, host de-pooled from the broker list) | 
  [production] | 
            
  | 10:11 | 
  <moritzm> | 
  repooling restbase2006 | 
  [production] | 
            
  | 10:01 | 
  <jynus> | 
  applying live on the 7 sanitarium instance the newly puppet-configured labs replication filters | 
  [production] | 
            
  | 09:57 | 
  <moritzm> | 
  repooling restbase2005, depooling restbase2006 for kernel reboot/Java update | 
  [production] | 
            
  | 09:46 | 
  <dcausse> | 
  elastic in codfw: reducing the number of replicas from 0-3 to 0-2 for commonswiki_file | 
  [production] | 
            
  | 09:46 | 
  <moritzm> | 
  repooling restbase2004, depooling restbase2005 for kernel reboot/Java update | 
  [production] | 
            
  | 09:39 | 
  <ema> | 
  re-enabling puppet on mw1161 | 
  [production] | 
            
  | 09:34 | 
  <moritzm> | 
  depooling restbase2004 for kernel reboot/Java update | 
  [production] | 
            
  | 09:10 | 
  <jynus> | 
  converting remaining InnoDB tables (s3) to TokuDB on db1069 | 
  [production] | 
            
  | 08:14 | 
  <chasemp> | 
  iridium puppet agent --enable && puppet agent --disable "DO NO ENABLE AS IT WILL BREAK THINGS CONTACT MUKUNDA" | 
  [production] | 
            
  | 07:51 | 
  <twentyafterfour> | 
  phabricator repositories checked out to these revisions: http://pastebin.com/JxEaYKiW | 
  [production] | 
            
  | 07:49 | 
  <chasemp> | 
  git checkout tag release/2015-11-18/1 for phab & libphutil on iridiuum | 
  [production] | 
            
  | 07:35 | 
  <andrewbogott> | 
  disabling puppet on iridium to prevent it from smashing phabricator (as it seems to do now and then) | 
  [production] | 
            
  | 07:00 | 
  <andrewbogott> | 
  on iridium in /srv/deployment/phabricator/deploy/phabricator, naming the currently detached git branch ‘andrewfounditlikethis' | 
  [production] |