| 
      
        2018-01-03
      
      ยง
     | 
  
    
  | 16:18 | 
  <otto@tin> | 
  Started deploy [statsv/statsv@0a86be8]: revert | 
  [production] | 
            
  | 16:18 | 
  <otto@tin> | 
  Finished deploy [statsv/statsv@c390cdf]: no-op deployment of statsv with support for multiple topics (duration: 00m 03s) | 
  [production] | 
            
  | 16:18 | 
  <otto@tin> | 
  Started deploy [statsv/statsv@c390cdf]: no-op deployment of statsv with support for multiple topics | 
  [production] | 
            
  | 16:14 | 
  <papaul> | 
  powering down mw2251 for memory replacement and firmware uprade | 
  [production] | 
            
  | 16:02 | 
  <urandom> | 
  drop unused keyspaces in legacy restbase cluster - T183745 | 
  [production] | 
            
  | 15:51 | 
  <niharika29@tin> | 
  Finished deploy [scholarships/scholarships@ec05ae7]: Remove outdated i18n files (duration: 00m 02s) | 
  [production] | 
            
  | 15:51 | 
  <niharika29@tin> | 
  Started deploy [scholarships/scholarships@ec05ae7]: Remove outdated i18n files | 
  [production] | 
            
  | 15:48 | 
  <jynus> | 
  stop pc2005's database for maintenance T183750 | 
  [production] | 
            
  | 15:46 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: "Depool" pc2005 (duration: 01m 02s) | 
  [production] | 
            
  | 15:38 | 
  <elukey@puppetmaster1001> | 
  conftool action : set/pooled=inactive; selector: name=mw2251.*.wmnet | 
  [production] | 
            
  | 15:28 | 
  <niharika29@tin> | 
  Finished deploy [scholarships/scholarships@ec05ae7]: Update i18n files (duration: 00m 02s) | 
  [production] | 
            
  | 15:28 | 
  <niharika29@tin> | 
  Started deploy [scholarships/scholarships@ec05ae7]: Update i18n files | 
  [production] | 
            
  | 15:14 | 
  <jynus@tin> | 
  Synchronized wmf-config/db-codfw.php: Switchover s6-master db2028 to db2039 (duration: 01m 01s) | 
  [production] | 
            
  | 15:08 | 
  <jynus> | 
  stopping db2028's mysql to apply new config | 
  [production] | 
            
  | 15:01 | 
  <godog> | 
  roll-restart thumbor in eqiad after upgrade - T183907 | 
  [production] | 
            
  | 15:00 | 
  <ottomata> | 
  restarting kafka-jumbo brokers to enable tls version and cipher suite restrictions | 
  [production] | 
            
  | 14:55 | 
  <jynus> | 
  switchover db2028 to db2039 as codfw-s6-master | 
  [production] | 
            
  | 14:39 | 
  <godog> | 
  rollout python-thumbor-wikimedia 1.8 - T183907 | 
  [production] | 
            
  | 14:30 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 14:29 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:401174|Add Translation NS for kowikisource (T183836)]] (duration: 01m 00s) | 
  [production] | 
            
  | 14:16 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:401160|Add patrol to Image-reviewer on Commons (T183835)]] (duration: 01m 02s) | 
  [production] | 
            
  | 13:40 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1086 - T174569 (duration: 01m 02s) | 
  [production] | 
            
  | 13:17 | 
  <moritzm> | 
  upgrading mw1261-mw1265 to HHVM  3.18.5+dfsg-1+wmf2 | 
  [production] | 
            
  | 13:07 | 
  <moritzm> | 
  uploaded hhvm 3.18.5+dfsg-1+wmf2 (including the fixes from 3.18.6) for jessie-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 12:53 | 
  <moritzm> | 
  importing linux 4.9.65-3+deb9u1~bpo8+1 for jessie-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 12:14 | 
  <mobrovac@tin> | 
  Finished deploy [mathoid/deploy@63b2ddc]: Bring back codfw in sync with eqiad - T183557 (duration: 02m 10s) | 
  [production] | 
            
  | 12:12 | 
  <mobrovac@tin> | 
  Started deploy [mathoid/deploy@63b2ddc]: Bring back codfw in sync with eqiad - T183557 | 
  [production] | 
            
  | 11:57 | 
  <moritzm> | 
  upgrading app servers in deployment-prep to hhvm 3.18.5+dfsg-1+wmf2 (which contains the patches from 3.18.6) | 
  [production] | 
            
  | 11:52 | 
  <jynus> | 
  upgrade and restart db2039 | 
  [production] | 
            
  | 11:49 | 
  <jynus> | 
  disabling puppet on db2039 and db2028 in preparation for gerrit:401706 deployment | 
  [production] | 
            
  | 11:47 | 
  <akosiaris> | 
  boot ganeti1006. It exhibited page allocation stalls on Jan 1. T181121 | 
  [production] | 
            
  | 11:39 | 
  <marostegui> | 
  Deploy schema change on db1086 - T174569 | 
  [production] | 
            
  | 11:38 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1086 - T174569 (duration: 01m 01s) | 
  [production] | 
            
  | 11:32 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 - T174569 (duration: 01m 02s) | 
  [production] | 
            
  | 11:32 | 
  <mobrovac@tin> | 
  Finished deploy [mathoid/deploy@91648aa]: Update to Mathoid v0.7.0 in codfw only for T183557 (duration: 02m 15s) | 
  [production] | 
            
  | 11:29 | 
  <mobrovac@tin> | 
  Started deploy [mathoid/deploy@91648aa]: Update to Mathoid v0.7.0 in codfw only for T183557 | 
  [production] | 
            
  | 11:28 | 
  <mobrovac@tin> | 
  Finished deploy [mathoid/deploy@91648aa]: (no justification provided) (duration: 00m 40s) | 
  [production] | 
            
  | 11:28 | 
  <mobrovac@tin> | 
  Started deploy [mathoid/deploy@91648aa]: (no justification provided) | 
  [production] | 
            
  | 11:03 | 
  <elukey@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=mw1336.*.eqiad.wmnet | 
  [production] | 
            
  | 11:00 | 
  <mobrovac@tin> | 
  Started restart [changeprop/deploy@3c4f51d]: Pick up the new RESTBase DNS | 
  [production] | 
            
  | 10:48 | 
  <mobrovac@tin> | 
  Started restart [mobileapps/deploy@bf85a55]: Pick up the new RESTBase DNS | 
  [production] | 
            
  | 10:45 | 
  <oblivian@puppetmaster1001> | 
  conftool action : set/pooled=true; selector: dnsdisc=restbase,name=codfw | 
  [production] | 
            
  | 09:57 | 
  <elukey@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=mw1337.*.eqiad.wmnet | 
  [production] | 
            
  | 08:59 | 
  <elukey> | 
  stop eventlogging mysql insertion on eventlog1001 to allow db1107 maintenance - T168414 | 
  [production] | 
            
  | 06:57 | 
  <marostegui> | 
  Deploy schema change on db1101:3317 - T174569 | 
  [production] | 
            
  | 06:57 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1101:3317 - T174569 (duration: 01m 01s) | 
  [production] | 
            
  | 06:50 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 - T174569 (duration: 01m 10s) | 
  [production] | 
            
  | 06:47 | 
  <kartik@tin> | 
  Finished deploy [cxserver/deploy@66e384e]: Update cxserver to cc01477 (duration: 04m 49s) | 
  [production] | 
            
  | 06:43 | 
  <kartik@tin> | 
  Started deploy [cxserver/deploy@66e384e]: Update cxserver to cc01477 | 
  [production] | 
            
  | 06:37 | 
  <marostegui> | 
  Deploy schema change on s1 master db1052 - T174569 | 
  [production] |