| 
      
        2019-03-08
      
      §
     | 
  
    
  | 11:07 | 
  <moritzm> | 
  uploaded tideways 4.0.7-1+wmf1 for component/php72 (T216712) | 
  [production] | 
            
  | 10:34 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1080, db1110 (duration: 00m 49s) | 
  [production] | 
            
  | 10:14 | 
  <marostegui> | 
  Reload haproxy on dbproxy1011 to repool labsdb1009 | 
  [production] | 
            
  | 09:51 | 
  <mutante> | 
  temp disabling puppet on icinga to debug an issue with elastic checks | 
  [production] | 
            
  | 09:39 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1080, db1110 (duration: 00m 49s) | 
  [production] | 
            
  | 09:15 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1099:3311,db1096:3315 (duration: 00m 49s) | 
  [production] | 
            
  | 08:37 | 
  <marostegui> | 
  Reload haproxy on dbproxy1011 to depool labsdb1009 | 
  [production] | 
            
  | 08:31 | 
  <marostegui> | 
  Reload haproxy on dbproxy1010 to repool labsdb1011 | 
  [production] | 
            
  | 08:20 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1099:3311,db1096:3315 (duration: 00m 48s) | 
  [production] | 
            
  | 08:11 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Fully repool db1076 (duration: 00m 48s) | 
  [production] | 
            
  | 07:59 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 00m 40s) | 
  [production] | 
            
  | 07:58 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | 
  [production] | 
            
  | 07:57 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 00m 02s) | 
  [production] | 
            
  | 07:57 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | 
  [production] | 
            
  | 07:52 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 01m 18s) | 
  [production] | 
            
  | 07:52 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1077 (duration: 00m 48s) | 
  [production] | 
            
  | 07:51 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | 
  [production] | 
            
  | 07:49 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: More traffic to db1076 after mysql upgrade (duration: 00m 49s) | 
  [production] | 
            
  | 07:35 | 
  <elukey@deploy1001> | 
  Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 00m 30s) | 
  [production] | 
            
  | 07:34 | 
  <elukey@deploy1001> | 
  Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | 
  [production] | 
            
  | 07:22 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 after mysql upgrade (duration: 00m 49s) | 
  [production] | 
            
  | 07:13 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1076 into API after mysql upgrade (duration: 00m 48s) | 
  [production] | 
            
  | 07:04 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 after mysql upgrade (duration: 00m 48s) | 
  [production] | 
            
  | 06:53 | 
  <marostegui> | 
  Stop MySQL on db1076 for upgrade | 
  [production] | 
            
  | 06:52 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1076 for mysql upgrade (duration: 00m 49s) | 
  [production] | 
            
  | 06:22 | 
  <marostegui> | 
  Deploy schema change on s3 db1077 with replication (lag will happen on s3 labs) | 
  [production] | 
            
  | 06:21 | 
  <marostegui> | 
  Stop replication on s3 on labsdb1009 and labsdb1011 | 
  [production] | 
            
  | 06:20 | 
  <marostegui> | 
  Reload haproxy on dbproxy1010 to depool labsdb1010 | 
  [production] | 
            
  | 06:18 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1077 (duration: 00m 51s) | 
  [production] | 
            
  | 00:23 | 
  <thcipriani@deploy1001> | 
  Synchronized php-1.33.0-wmf.20/skins/MinervaNeue/resources/skins.minerva.scripts/toc.js: SWAT: [[gerrit:495021|Passing page parameter to TOC toggler]] T217820 (duration: 00m 50s) | 
  [production] | 
            
  | 00:16 | 
  <thcipriani@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:495024|Cleanup beta cluster config]] T213599; [[gerrit:495023|Enable advanced mobile contributions mode on beta cluster]] beta-only (noop) sync (duration: 00m 49s) | 
  [production] | 
            
  | 00:01 | 
  <ayounsi@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: name=dns2001.wikimedia.org,service=pdns_recursor | 
  [production] | 
            
  
    | 
      
        2019-03-07
      
      §
     | 
  
    
  | 23:53 | 
  <XioNoX> | 
  set net.ipv4.ip_local_port_range="32768 60999" on dns2001 and repool server - T209989 | 
  [production] | 
            
  | 23:46 | 
  <XioNoX> | 
  set net.ipv4.ip_local_port_range="49152 65535" on dns2001 - T209989 | 
  [production] | 
            
  | 23:43 | 
  <ayounsi@puppetmaster1001> | 
  conftool action : set/pooled=no; selector: name=dns2001.wikimedia.org,service=pdns_recursor | 
  [production] | 
            
  | 23:40 | 
  <XioNoX> | 
  depool dns2001 - T209989 | 
  [production] | 
            
  | 20:44 | 
  <XioNoX> | 
  explicitely disable sampling on non eqiad routers | 
  [production] | 
            
  | 20:42 | 
  <thcipriani> | 
  restarting gerrit on cobalt for 2.15.11 rollback | 
  [production] | 
            
  | 20:42 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) (duration: 00m 07s) | 
  [production] | 
            
  | 20:41 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) | 
  [production] | 
            
  | 20:40 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only (duration: 00m 10s) | 
  [production] | 
            
  | 20:40 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only | 
  [production] | 
            
  | 20:10 | 
  <thcipriani> | 
  restarting gerrit on cobalt for 2.15.11 upgrade | 
  [production] | 
            
  | 20:10 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) (duration: 00m 11s) | 
  [production] | 
            
  | 20:09 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) | 
  [production] | 
            
  | 20:07 | 
  <thcipriani@deploy1001> | 
  Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only (duration: 00m 12s) | 
  [production] | 
            
  | 20:07 | 
  <thcipriani@deploy1001> | 
  Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only | 
  [production] | 
            
  | 19:33 | 
  <gilles@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: T216499 Enable Priority Hints origin trial on ruwiki (duration: 00m 48s) | 
  [production] | 
            
  | 19:22 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Grant 'reupload-shared' to mediawiki uploaders and fix  T217523 (duration: 00m 49s) | 
  [production] | 
            
  | 19:12 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable Partial Blocks on Arabic Wikipedia T217283 (duration: 00m 50s) | 
  [production] |