| 2019-03-08
      
      § | 
    
  | 07:57 | <elukey@deploy1001> | Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 00m 02s) | [production] | 
            
  | 07:57 | <elukey@deploy1001> | Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | [production] | 
            
  | 07:52 | <elukey@deploy1001> | Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 01m 18s) | [production] | 
            
  | 07:52 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1077 (duration: 00m 48s) | [production] | 
            
  | 07:51 | <elukey@deploy1001> | Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | [production] | 
            
  | 07:49 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1076 after mysql upgrade (duration: 00m 49s) | [production] | 
            
  | 07:35 | <elukey@deploy1001> | Finished deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster (duration: 00m 30s) | [production] | 
            
  | 07:34 | <elukey@deploy1001> | Started deploy [analytics/superset/deploy@UNKNOWN]: Test deployment for Buster | [production] | 
            
  | 07:22 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 after mysql upgrade (duration: 00m 49s) | [production] | 
            
  | 07:13 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1076 into API after mysql upgrade (duration: 00m 48s) | [production] | 
            
  | 07:04 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 after mysql upgrade (duration: 00m 48s) | [production] | 
            
  | 06:53 | <marostegui> | Stop MySQL on db1076 for upgrade | [production] | 
            
  | 06:52 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1076 for mysql upgrade (duration: 00m 49s) | [production] | 
            
  | 06:22 | <marostegui> | Deploy schema change on s3 db1077 with replication (lag will happen on s3 labs) | [production] | 
            
  | 06:21 | <marostegui> | Stop replication on s3 on labsdb1009 and labsdb1011 | [production] | 
            
  | 06:20 | <marostegui> | Reload haproxy on dbproxy1010 to depool labsdb1010 | [production] | 
            
  | 06:18 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1077 (duration: 00m 51s) | [production] | 
            
  | 00:23 | <thcipriani@deploy1001> | Synchronized php-1.33.0-wmf.20/skins/MinervaNeue/resources/skins.minerva.scripts/toc.js: SWAT: [[gerrit:495021|Passing page parameter to TOC toggler]] T217820 (duration: 00m 50s) | [production] | 
            
  | 00:16 | <thcipriani@deploy1001> | Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:495024|Cleanup beta cluster config]] T213599; [[gerrit:495023|Enable advanced mobile contributions mode on beta cluster]] beta-only (noop) sync (duration: 00m 49s) | [production] | 
            
  | 00:01 | <ayounsi@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=dns2001.wikimedia.org,service=pdns_recursor | [production] | 
            
  
    | 2019-03-07
      
      § | 
    
  | 23:53 | <XioNoX> | set net.ipv4.ip_local_port_range="32768 60999" on dns2001 and repool server - T209989 | [production] | 
            
  | 23:46 | <XioNoX> | set net.ipv4.ip_local_port_range="49152 65535" on dns2001 - T209989 | [production] | 
            
  | 23:43 | <ayounsi@puppetmaster1001> | conftool action : set/pooled=no; selector: name=dns2001.wikimedia.org,service=pdns_recursor | [production] | 
            
  | 23:40 | <XioNoX> | depool dns2001 - T209989 | [production] | 
            
  | 20:44 | <XioNoX> | explicitely disable sampling on non eqiad routers | [production] | 
            
  | 20:42 | <thcipriani> | restarting gerrit on cobalt for 2.15.11 rollback | [production] | 
            
  | 20:42 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) (duration: 00m 07s) | [production] | 
            
  | 20:41 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) | [production] | 
            
  | 20:40 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only (duration: 00m 10s) | [production] | 
            
  | 20:40 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only | [production] | 
            
  | 20:10 | <thcipriani> | restarting gerrit on cobalt for 2.15.11 upgrade | [production] | 
            
  | 20:10 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) (duration: 00m 11s) | [production] | 
            
  | 20:09 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) | [production] | 
            
  | 20:07 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only (duration: 00m 12s) | [production] | 
            
  | 20:07 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only | [production] | 
            
  | 19:33 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T216499 Enable Priority Hints origin trial on ruwiki (duration: 00m 48s) | [production] | 
            
  | 19:22 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Grant 'reupload-shared' to mediawiki uploaders and fix  T217523 (duration: 00m 49s) | [production] | 
            
  | 19:12 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Partial Blocks on Arabic Wikipedia T217283 (duration: 00m 50s) | [production] | 
            
  | 19:04 | <arlolra> | Updated Parsoid to d4e76d5 (T202905) | [production] | 
            
  | 18:56 | <arlolra@deploy1001> | Finished deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 (duration: 05m 01s) | [production] | 
            
  | 18:51 | <arlolra@deploy1001> | Started deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 | [production] | 
            
  | 18:39 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=codfw,cluster=maps,name=maps2004.codfw.wmnet | [production] | 
            
  | 18:32 | <mbsantos@deploy1001> | Finished deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 01m 25s) | [production] | 
            
  | 18:30 | <mbsantos@deploy1001> | Started deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet | [production] | 
            
  | 18:30 | <mbsantos@deploy1001> | Finished deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 03m 46s) | [production] | 
            
  | 18:26 | <mbsantos@deploy1001> | Started deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet | [production] | 
            
  | 18:25 | <gehel> | cleaning kernel-proposed-updates component on reprepro (install1002) | [production] | 
            
  | 18:15 | <XioNoX> | disable asw2-c-eqiad <-> asw-c-eqiad link - T208734 | [production] | 
            
  | 17:55 | <gehel> | rolling upgrade of kibana on logstash clusters completed - T216052 | [production] | 
            
  | 17:48 | <gehel> | rolling upgrade of kibana on logstash clusters - T216052 | [production] |