| 2019-03-07
      
      ยง | 
    
  | 20:44 | <XioNoX> | explicitely disable sampling on non eqiad routers | [production] | 
            
  | 20:42 | <thcipriani> | restarting gerrit on cobalt for 2.15.11 rollback | [production] | 
            
  | 20:42 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) (duration: 00m 07s) | [production] | 
            
  | 20:41 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on cobalt (production) | [production] | 
            
  | 20:40 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only (duration: 00m 10s) | [production] | 
            
  | 20:40 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Revert "Gerrit to 2.15.11" on gerrit2001 only | [production] | 
            
  | 20:10 | <thcipriani> | restarting gerrit on cobalt for 2.15.11 upgrade | [production] | 
            
  | 20:10 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) (duration: 00m 11s) | [production] | 
            
  | 20:09 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on cobalt (production) | [production] | 
            
  | 20:07 | <thcipriani@deploy1001> | Finished deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only (duration: 00m 12s) | [production] | 
            
  | 20:07 | <thcipriani@deploy1001> | Started deploy [gerrit/gerrit@5800deb]: Gerrit to 2.15.11 on gerrit2001 only | [production] | 
            
  | 19:33 | <gilles@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: T216499 Enable Priority Hints origin trial on ruwiki (duration: 00m 48s) | [production] | 
            
  | 19:22 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Grant 'reupload-shared' to mediawiki uploaders and fix  T217523 (duration: 00m 49s) | [production] | 
            
  | 19:12 | <niharika29@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Partial Blocks on Arabic Wikipedia T217283 (duration: 00m 50s) | [production] | 
            
  | 19:04 | <arlolra> | Updated Parsoid to d4e76d5 (T202905) | [production] | 
            
  | 18:56 | <arlolra@deploy1001> | Finished deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 (duration: 05m 01s) | [production] | 
            
  | 18:51 | <arlolra@deploy1001> | Started deploy [parsoid/deploy@766a920]: Updating Parsoid to d4e76d5 | [production] | 
            
  | 18:39 | <gehel@puppetmaster1001> | conftool action : set/pooled=yes; selector: dc=codfw,cluster=maps,name=maps2004.codfw.wmnet | [production] | 
            
  | 18:32 | <mbsantos@deploy1001> | Finished deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 01m 25s) | [production] | 
            
  | 18:30 | <mbsantos@deploy1001> | Started deploy [kartotherian/deploy@248b8c4] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet | [production] | 
            
  | 18:30 | <mbsantos@deploy1001> | Finished deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet (duration: 03m 46s) | [production] | 
            
  | 18:26 | <mbsantos@deploy1001> | Started deploy [tilerator/deploy@fac7e5e] (stretch): Updating eqiad cluster before repool of maps2004.codfw.wmnet | [production] | 
            
  | 18:25 | <gehel> | cleaning kernel-proposed-updates component on reprepro (install1002) | [production] | 
            
  | 18:15 | <XioNoX> | disable asw2-c-eqiad <-> asw-c-eqiad link - T208734 | [production] | 
            
  | 17:55 | <gehel> | rolling upgrade of kibana on logstash clusters completed - T216052 | [production] | 
            
  | 17:48 | <gehel> | rolling upgrade of kibana on logstash clusters - T216052 | [production] | 
            
  | 17:43 | <gehel> | rolling upgrade of logstash on logstash clusters completed - T216052 | [production] | 
            
  | 17:36 | <gehel> | rolling upgrade of logstash on logstash clusters - T216052 | [production] | 
            
  | 17:34 | <gehel@deploy1001> | Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 07s) | [production] | 
            
  | 17:34 | <gehel@deploy1001> | Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 | [production] | 
            
  | 17:34 | <gehel@deploy1001> | Finished deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 (duration: 00m 08s) | [production] | 
            
  | 17:33 | <gehel@deploy1001> | Started deploy [logstash/plugins@7c4c5ea]: upgrade logstash plugins to 5.6.14 - T216052 | [production] | 
            
  | 17:16 | <gehel> | rolling upgrade of elasticsearch on logstash clusters completed - T216052 | [production] | 
            
  | 17:09 | <ariel@deploy1001> | Finished deploy [dumps/dumps@3e25558]: fix broken page-content job retries (duration: 00m 04s) | [production] | 
            
  | 17:09 | <ariel@deploy1001> | Started deploy [dumps/dumps@3e25558]: fix broken page-content job retries | [production] | 
            
  | 16:54 | <cmjohnson1> | powering off cp1099 to move to different rack T202966 | [production] | 
            
  | 15:26 | <gehel> | rolling upgrade of elasticsearch on logstash clusters - T216052 | [production] | 
            
  | 14:54 | <hashar> | 1.33.0-wmf.20 seems all good | [production] | 
            
  | 14:46 | <marostegui> | Reload haproxy on dbproxy1011 to repool labsdb1009 | [production] | 
            
  | 14:15 | <hashar@deploy1001> | rebuilt and synchronized wikiversions files: all wikis to 1.33.0-wmf.20 | [production] | 
            
  | 13:47 | <mutante> | phab1002 - removing all php-7.2 packages and letting puppet reinstall them after component change | [production] | 
            
  | 13:42 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1075 after schema change and mysql upgrade (duration: 00m 55s) | [production] | 
            
  | 13:41 | <marostegui> | Stop mysql on labsdb1009 for upgrade (this will trigger an haproxy IRC alert) | [production] | 
            
  | 13:39 | <marostegui> | Reload haproxy on dbproxy1010 to depool labsdb1009 | [production] | 
            
  | 13:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: More traffic to db1075 after schema change and mysql upgrade (duration: 00m 52s) | [production] | 
            
  | 12:59 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 12:56 | <gtirloni> | re-enabled puppet on seaborgium/serpens | [production] | 
            
  | 12:55 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:493010|Enable musical notation datatype on testwikidatawiki (T216730)]] (duration: 00m 56s) | [production] | 
            
  | 12:42 | <ariel@deploy1001> | Finished deploy [dumps/dumps@3a25aa0]: handle failed xml content jobs correctly (fix regression) (duration: 00m 05s) | [production] | 
            
  | 12:42 | <ariel@deploy1001> | Started deploy [dumps/dumps@3a25aa0]: handle failed xml content jobs correctly (fix regression) | [production] |