| 
      
        2018-12-05
      
      §
     | 
  
    
  | 11:28 | 
  <mobrovac@deploy1001> | 
  Finished deploy [citoid/deploy@b10e034]: Truncate Zotero-reported time stamp to date - T211127 (duration: 05m 55s) | 
  [production] | 
            
  | 11:23 | 
  <mobrovac@deploy1001> | 
  Started deploy [citoid/deploy@b10e034]: Truncate Zotero-reported time stamp to date - T211127 | 
  [production] | 
            
  | 11:05 | 
  <akosiaris> | 
  upgrade kubernetes-client and kubernetes-master on staging to 1.10.11 | 
  [production] | 
            
  | 11:04 | 
  <godog> | 
  bootstrap cassandra-b, restbase2017 - T210843 | 
  [production] | 
            
  | 10:59 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 (duration: 00m 45s) | 
  [production] | 
            
  | 10:56 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1090:3317 (duration: 00m 45s) | 
  [production] | 
            
  | 10:51 | 
  <ema> | 
  cache hosts: begin nginx rolling upgrade to 1.13.6-2+wmf2 | 
  [production] | 
            
  | 10:46 | 
  <marostegui> | 
  Reboot db1090 for kernel upgrade | 
  [production] | 
            
  | 10:44 | 
  <moritzm> | 
  uploaded jenkins 2.138.4 to jessie-wikimedia/thirdparty and stretch-wikimedia/thirdpary/ci | 
  [production] | 
            
  | 10:42 | 
  <marostegui> | 
  Stop MySQL on db1090:3312 and db1090:3317 for MySQL upgrade | 
  [production] | 
            
  | 10:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 (duration: 00m 46s) | 
  [production] | 
            
  | 10:38 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1090:3317 (duration: 00m 46s) | 
  [production] | 
            
  | 10:25 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1080 (duration: 00m 46s) | 
  [production] | 
            
  | 10:21 | 
  <gehel@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: dc=codfw,cluster=elasticsearch | 
  [production] | 
            
  | 10:17 | 
  <arturo> | 
  T205969 icinga downtime the load avg check in labstore1007 for 1 week | 
  [production] | 
            
  | 10:10 | 
  <banyek> | 
  depooling labsdb1010 for testing materialized views - T210693 | 
  [production] | 
            
  | 10:02 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Increase weight for db1080 (duration: 00m 46s) | 
  [production] | 
            
  | 09:42 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly pool db1080 (duration: 00m 46s) | 
  [production] | 
            
  | 09:32 | 
  <gehel> | 
  setting up new elasticsearch servers on codfw - elastic2045-2054 - T210265 | 
  [production] | 
            
  | 09:22 | 
  <marostegui> | 
  Stop MySQL on db1080 for mysql and kernel upgrade | 
  [production] | 
            
  | 09:17 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1080 for MySQL upgrade (duration: 00m 46s) | 
  [production] | 
            
  | 09:07 | 
  <elukey> | 
  matomo read only + upgrade to matomo 3.7.0 on matomo1001 - T209808 | 
  [production] | 
            
  | 09:00 | 
  <_joe_> | 
  disabed puppet on mw1261, used for logging tests for T211184 | 
  [production] | 
            
  | 08:48 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T207850 Define a new Wikibase log channel to use (duration: 00m 47s) | 
  [production] | 
            
  | 08:01 | 
  <moritzm> | 
  installing pdns-recursor security update in esams | 
  [production] | 
            
  | 07:59 | 
  <godog> | 
  bootstrap cassandra-a, restbase2017 - T210843 | 
  [production] | 
            
  | 07:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1091 T86338 T202167 (duration: 00m 46s) | 
  [production] | 
            
  | 06:55 | 
  <marostegui> | 
  Deploy schema change on db1091 T86338 T202167 | 
  [production] | 
            
  | 06:55 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1091 T86338 T202167 (duration: 00m 51s) | 
  [production] | 
            
  | 04:03 | 
  <urandom> | 
  bootstrapping cassandra-c, restbase2016 -- T210843 | 
  [production] | 
            
  | 03:11 | 
  <kartik@deploy1001> | 
  Finished deploy [cxserver/deploy@a3dd2ca]: Update cxserver to c4240e6 and enable Youdao MT (T208985, T210578) (duration: 04m 26s) | 
  [production] | 
            
  | 03:06 | 
  <kartik@deploy1001> | 
  Started deploy [cxserver/deploy@a3dd2ca]: Update cxserver to c4240e6 and enable Youdao MT (T208985, T210578) | 
  [production] | 
            
  | 00:32 | 
  <dcausse> | 
  Evening SWAT done | 
  [production] | 
            
  | 00:30 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s) | 
  [production] | 
            
  | 00:28 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/ProductionServices.php: [cirrus] prepare multi-instance services (T210381) (duration: 00m 46s) | 
  [production] | 
            
  | 00:16 | 
  <dcausse@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable Block notice stats on itwiki (T210452) (duration: 00m 47s) | 
  [production] | 
            
  | 00:10 | 
  <urandom> | 
  bootstrapping cassandra-b, restbase2016 -- T210843 | 
  [production] | 
            
  
    | 
      
        2018-12-04
      
      §
     | 
  
    
  | 23:46 | 
  <eileen> | 
  civicrm revision changed from a411d6bd64 to e757753a46, config revision is 0e6ccc37fe | 
  [production] | 
            
  | 23:33 | 
  <XioNoX> | 
  update prefix-list peering4 on cr1-eqsin to match jnt | 
  [production] | 
            
  | 22:46 | 
  <XioNoX> | 
  remove neodymium/sarin from term labs-in4 on cr1/2-eqiad - T210612 | 
  [production] | 
            
  | 22:40 | 
  <ejegg> | 
  Updated payments-wiki from 7403a196b4 to 20595cca97 | 
  [production] | 
            
  | 21:58 | 
  <XioNoX> | 
  clear ethernet-swtiching table for labvirt1004:eth1's switch port | 
  [production] | 
            
  | 21:57 | 
  <XioNoX> | 
  clear ethernet-swtiching table for labvirt1009:eth1's switch port | 
  [production] | 
            
  | 21:49 | 
  <XioNoX> | 
  make cr1/2-codfw conform to jnt | 
  [production] | 
            
  | 21:44 | 
  <XioNoX> | 
  make cr2-eqord/eqdfw conform to jnt | 
  [production] | 
            
  | 21:41 | 
  <XioNoX> | 
  make cr3/4-ulsfo conform to jnt | 
  [production] | 
            
  | 20:04 | 
  <urandom> | 
  bootstrapping cassandra-a, restbase2016 -- T210843 | 
  [production] | 
            
  | 19:35 | 
  <smalyshev@deploy1001> | 
  Finished deploy [wdqs/wdqs@81dac18]: Install new Updater for T210044 investigation (duration: 10m 36s) | 
  [production] | 
            
  | 19:24 | 
  <smalyshev@deploy1001> | 
  Started deploy [wdqs/wdqs@81dac18]: Install new Updater for T210044 investigation | 
  [production] | 
            
  | 18:04 | 
  <joal@deploy1001> | 
  Finished deploy [analytics/aqs/deploy@e7d48e9]: Add underestimate and offset to uniques-devices endpoint (duration: 17m 33s) | 
  [production] |