| 
      
        2018-08-22
      
      ยง
     | 
  
    
  | 16:06 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1096:3316 (duration: 00m 55s) | 
  [production] | 
            
  | 16:02 | 
  <XioNoX> | 
  add static NAT for 208.80.155.15 - T202520 | 
  [production] | 
            
  | 15:54 | 
  <XioNoX> | 
  Update NAT for 208.80.152.231 - T202536 | 
  [production] | 
            
  | 14:57 | 
  <elukey> | 
  upload archiva 2.2.3-2 to stretch-wikimedia | 
  [production] | 
            
  | 14:57 | 
  <XioNoX> | 
  load eqiad-1534946573 on pfw3-eqiad - T202537 | 
  [production] | 
            
  | 14:56 | 
  <elukey> | 
  update pcc's facts | 
  [production] | 
            
  | 14:55 | 
  <XioNoX> | 
  load codfw-1534946573 on pfw3-codfw - T202537 | 
  [production] | 
            
  | 14:24 | 
  <marostegui> | 
  Deploy schema change on dbstore1002 | 
  [production] | 
            
  | 14:11 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool es1011 (duration: 00m 55s) | 
  [production] | 
            
  | 14:03 | 
  <moritzm> | 
  installing openssl updates | 
  [production] | 
            
  | 13:15 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config: BETA ONLY (1 wikidata patch) (duration: 00m 56s) | 
  [production] | 
            
  | 13:14 | 
  <addshore@deploy1001> | 
  sync-file aborted: BETA ONLY (1 wikidata patche) (duration: 00m 00s) | 
  [production] | 
            
  | 13:07 | 
  <reedy@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Set default for wgMultiContentRevisionSchemaMigrationStage T197816 (duration: 00m 56s) | 
  [production] | 
            
  | 12:59 | 
  <marostegui> | 
  Deploy schema change on s6 codfw masters (db2039) this will generate lag on s6 codfw | 
  [production] | 
            
  | 12:46 | 
  <addshore@deploy1001> | 
  Synchronized wmf-config: BETA ONLY (2 wikidata patches) (duration: 00m 55s) | 
  [production] | 
            
  | 12:16 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 (duration: 00m 57s) | 
  [production] | 
            
  | 12:15 | 
  <marostegui> | 
  Deploy schema change on db1070 (s5 primary master) - T67448 T114117 T51191 | 
  [production] | 
            
  | 11:40 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2069 - T201603 (duration: 00m 56s) | 
  [production] | 
            
  | 11:37 | 
  <marostegui> | 
  Deploy schema change on db1113:3315 | 
  [production] | 
            
  | 11:37 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1113:3315 (duration: 00m 58s) | 
  [production] | 
            
  | 10:43 | 
  <elukey> | 
  upload archiva 2.2.3-1 to stretch-wikimedia/main - T192639 | 
  [production] | 
            
  | 10:31 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #5 (duration: 06m 15s) | 
  [production] | 
            
  | 10:30 | 
  <Amir1> | 
  deploying ores gerrit:454283 to beta (T197097) | 
  [production] | 
            
  | 10:25 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #5 | 
  [production] | 
            
  | 10:25 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #4 (duration: 08m 31s) | 
  [production] | 
            
  | 10:17 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #4 | 
  [production] | 
            
  | 10:16 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #3 (duration: 08m 28s) | 
  [production] | 
            
  | 10:08 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c]: Expand CSS end points, take #3 | 
  [production] | 
            
  | 10:08 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c]: Expand CSS end points - T202105 (duration: 13m 33s) | 
  [production] | 
            
  | 09:59 | 
  <jynus> | 
  restarting backups on codfw due to grant issue | 
  [production] | 
            
  | 09:54 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c]: Expand CSS end points - T202105 | 
  [production] | 
            
  | 09:53 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c]: Expand CSS end points - T202425 (duration: 03m 25s) | 
  [production] | 
            
  | 09:51 | 
  <moritzm> | 
  uploaded clustershell 1.8-1~deb9u1 to apt.wikimedia.org/stretch-wikimedia | 
  [production] | 
            
  | 09:49 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c]: Expand CSS end points - T202425 | 
  [production] | 
            
  | 09:49 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@5d03f1c] (dev-cluster): Expand CSS end points (duration: 03m 35s) | 
  [production] | 
            
  | 09:45 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@5d03f1c] (dev-cluster): Expand CSS end points | 
  [production] | 
            
  | 09:34 | 
  <moritzm> | 
  installing nodejs security updates on restbase* | 
  [production] | 
            
  | 09:19 | 
  <jynus> | 
  reimage es1011 to stretch | 
  [production] | 
            
  | 09:06 | 
  <addshore@deploy1001> | 
  Synchronized php-1.32.0-wmf.18/includes: T202483 [[gerrit:454486|The BlobStoreFactory constructor needs an LBFactory]] (duration: 01m 18s) | 
  [production] | 
            
  | 08:50 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool es1011 (duration: 00m 56s) | 
  [production] | 
            
  | 08:46 | 
  <marostegui> | 
  Stop replication on x1 codfw master (db2034) for data fixes - T104459 T201603 | 
  [production] | 
            
  | 08:40 | 
  <moritzm> | 
  installing clamav security updates on mendelevium (bundling libmspack security update along) | 
  [production] | 
            
  | 08:39 | 
  <ema> | 
  repool eqiad for front-edge traffic | 
  [production] | 
            
  | 07:47 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Change x1 eqiad weights to give more weight to the most powerful server (duration: 00m 55s) | 
  [production] | 
            
  | 07:06 | 
  <moritzm> | 
  installing apache update on deploy1001/planet1001 | 
  [production] | 
            
  | 06:57 | 
  <moritzm> | 
  imported libargon-2.1 for thirdparty/php7.2 repo (T202478) | 
  [production] | 
            
  | 06:30 | 
  <jynus> | 
  finished es2 switchover T202364 | 
  [production] | 
            
  | 06:20 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Switchover es2 master eqiad from es1011 to es1015 (duration: 00m 55s) | 
  [production] | 
            
  | 06:12 | 
  <jynus@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool es2 (duration: 01m 05s) | 
  [production] | 
            
  | 06:11 | 
  <jynus> | 
  depool es2 to failover master from es1011 to es1015 | 
  [production] |