| 
      
        2016-06-01
      
      ยง
     | 
  
    
  | 20:55 | 
  <bearND> | 
  starting mobileapps deploy | 
  [production] | 
            
  | 20:49 | 
  <ejegg> | 
  updated paymentswiki from 7d222320b35ad8a44d8c77a4c3019364a49e53f2 to 44bd699d6700ac4faf3c2d772ba713b093ae8cb8 | 
  [production] | 
            
  | 20:44 | 
  <twentyafterfour@tin> | 
  rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.4 | 
  [production] | 
            
  | 20:39 | 
  <twentyafterfour@tin> | 
  Synchronized php-1.28.0-wmf.4/includes/cache/LinkBatch.php: deploy https://gerrit.wikimedia.org/r/#/c/292217/ (duration: 00m 27s) | 
  [production] | 
            
  | 20:17 | 
  <subbu> | 
  finished deploying parsoid sha afb0d522 | 
  [production] | 
            
  | 20:17 | 
  <urandom> | 
  Rolling restart of RESTBase (redistribute Cassandra client connections?) : T126629 | 
  [production] | 
            
  | 20:10 | 
  <subbu> | 
  synced new code; restarted parsoid on wtp1001 as a canary | 
  [production] | 
            
  | 20:07 | 
  <subbu> | 
  starting parsoid deploy | 
  [production] | 
            
  | 19:43 | 
  <ema> | 
  cp* hosts rebooted (T131928) | 
  [production] | 
            
  | 19:40 | 
  <bblack> | 
  restarting pybals for healthcheck config changes | 
  [production] | 
            
  | 18:25 | 
  <urandom> | 
  restarting Cassandra on restbase1007.eqiad.wmnet | 
  [production] | 
            
  | 18:19 | 
  <ejegg> | 
  updated payments-wiki from 5bb160e9898224e1d7d0a5c57fe408edb998a262 to 7d222320b35ad8a44d8c77a4c3019364a49e53f2 | 
  [production] | 
            
  | 18:16 | 
  <ottomata> | 
  stopping kafka broker on kafka1018 and rebooting node | 
  [production] | 
            
  | 17:51 | 
  <urandom> | 
  Restarting Cassandra on restbase1007.eqiad.wmnet : T126629 | 
  [production] | 
            
  | 17:48 | 
  <ema> | 
  depooled reboot of cp4* hosts (T131928) | 
  [production] | 
            
  | 17:47 | 
  <urandom> | 
  Temporarily disabling puppet to test setting on restbase1007.eqiad.wmnet : T126629 | 
  [production] | 
            
  | 17:15 | 
  <ejegg> | 
  rolled back payments-wiki from a335a3a6f8909d1e7e1a79877512a12a0561aa2a to 5bb160e9898224e1d7d0a5c57fe408edb998a262 | 
  [production] | 
            
  | 17:06 | 
  <ejegg> | 
  updated payments-wiki from 5bb160e9898224e1d7d0a5c57fe408edb998a262 to a335a3a6f8909d1e7e1a79877512a12a0561aa2a | 
  [production] | 
            
  | 17:05 | 
  <akosiaris> | 
  powered on lvs2006. disk change did not happen | 
  [production] | 
            
  | 17:05 | 
  <akosiaris> | 
  powered off lvs2006 for disk swap | 
  [production] | 
            
  | 16:54 | 
  <tgr@tin> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: T135504: enable AuthManager in beta (duration: 00m 32s) | 
  [production] | 
            
  | 16:39 | 
  <tgr@tin> | 
  Synchronized php-1.28.0-wmf.4/extensions/NewUserMessage/: backport [[gerrit:292168]] to update NewUserMessage for AuthManager (duration: 00m 29s) | 
  [production] | 
            
  | 16:22 | 
  <urandom> | 
  Disabling traces on restbase1008-a.eqiad.wmnet : T126629 | 
  [production] | 
            
  | 16:01 | 
  <thcipriani@tin> | 
  Finished scap: SWAT: [[gerrit:292103|Update for AuthManager]] (duration: 26m 05s) | 
  [production] | 
            
  | 15:58 | 
  <urandom> | 
  Setting trace probability on restbase1008-a.eqiad.wmnet to 5% : T126629 | 
  [production] | 
            
  | 15:58 | 
  <jynus> | 
  updating dns entry for db1080.eqiad.wment | 
  [production] | 
            
  | 15:58 | 
  <urandom> | 
  Disabling trace probability on restbase1007-a.eqiad.wmnet : T126629 | 
  [production] | 
            
  | 15:48 | 
  <urandom> | 
  Setting trace probability to 5% on restbase1007-a.eqiad.wmnet : T126629 | 
  [production] | 
            
  | 15:35 | 
  <thcipriani@tin> | 
  Started scap: SWAT: [[gerrit:292103|Update for AuthManager]] | 
  [production] | 
            
  | 15:33 | 
  <thcipriani@tin> | 
  Synchronized php-1.28.0-wmf.4/resources/src/moment-locale-overrides.js: SWAT: [[gerrit:292087|Avoid passing integers to mw.RegExp.escape]] (duration: 00m 24s) | 
  [production] | 
            
  | 15:29 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:291720|Remove centralauth-autoaccount right]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:26 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:292053|Enable bot passwords on zerowiki]] (duration: 00m 24s) | 
  [production] | 
            
  | 15:19 | 
  <paravoid> | 
  Re-enabling OSPF on all cr1-codfw row subnets | 
  [production] | 
            
  | 15:18 | 
  <paravoid> | 
  Re-enabling cr1-codfw et-0/* interfaces | 
  [production] | 
            
  | 15:18 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:291237|Revert "Enable RC patrol on ta.wikiquote"]] (duration: 00m 25s) | 
  [production] | 
            
  | 15:15 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:291218|Remove no longer used Echo configuration]] PART II (duration: 00m 26s) | 
  [production] | 
            
  | 15:14 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:291218|Remove no longer used Echo configuration]] PART I (duration: 00m 33s) | 
  [production] | 
            
  | 15:13 | 
  <paravoid> | 
  Rebooting cr1-codfw FPC 0 | 
  [production] | 
            
  | 15:09 | 
  <paravoid> | 
  Upgrading cr1-codfw FPC 0 all PICs firmware | 
  [production] | 
            
  | 15:08 | 
  <thcipriani@tin> | 
  Synchronized static/images/sul: SWAT: [[gerrit:288582|Make SUL icons square and use global defaults]] (duration: 00m 41s) | 
  [production] | 
            
  | 15:07 | 
  <paravoid> | 
  Disabling cr1-codfw et-0/* (all row uplinks) | 
  [production] | 
            
  | 15:03 | 
  <paravoid> | 
  Disabling OSPF on all cr1-codfw row subnets to drain FPC0 | 
  [production] | 
            
  | 15:03 | 
  <akosiaris> | 
  restarted grrrit-wm after gerrit restart | 
  [production] | 
            
  | 15:02 | 
  <akosiaris> | 
  restarted gerrit to enforce 100m maxObjectSizeLimit | 
  [production] | 
            
  | 14:59 | 
  <paravoid> | 
  Restoring VRRP priority on cr2-codfw | 
  [production] | 
            
  | 14:57 | 
  <bblack> | 
  depooled reboot of cp3048 (T131928) | 
  [production] | 
            
  | 14:57 | 
  <paravoid> | 
  Re-enabling OSPF on all cr2-codfw row subnets | 
  [production] | 
            
  | 14:54 | 
  <paravoid> | 
  Re-enabling cr2-codfw et-0/* interfaces | 
  [production] | 
            
  | 14:49 | 
  <paravoid> | 
  Rebooting cr2-codfw FPC 0 | 
  [production] | 
            
  | 14:48 | 
  <paravoid> | 
  Upgrading cr2-codfw FPC 0 all PICs firmware | 
  [production] |