| 
      
        2019-01-19
      
      §
     | 
  
    
  | 22:12 | 
  <ariel@deploy1001> | 
  Finished deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression (duration: 00m 03s) | 
  [production] | 
            
  | 22:12 | 
  <ariel@deploy1001> | 
  Started deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression | 
  [production] | 
            
  | 20:34 | 
  <gtirloni> | 
  upgraded and rebooted labstore200{3,4} | 
  [production] | 
            
  | 12:34 | 
  <onimisionipe> | 
  pool maps1003 - stretch migration is complete T198622 | 
  [production] | 
            
  | 12:08 | 
  <elukey> | 
  run 'start all slaves' on dbstore1002 after crash | 
  [production] | 
            
  | 08:42 | 
  <marostegui> | 
  Fixing dbstore1002 x1 replication T213670 | 
  [production] | 
            
  | 07:36 | 
  <elukey> | 
  restart pdfrender on scb1004 | 
  [production] | 
            
  | 05:55 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 14s) | 
  [production] | 
            
  | 05:55 | 
  <ebernhardson@deploy1001> | 
  Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | 
  [production] | 
            
  | 05:55 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 15s) | 
  [production] | 
            
  | 05:55 | 
  <ebernhardson@deploy1001> | 
  Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | 
  [production] | 
            
  | 05:46 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 13s) | 
  [production] | 
            
  | 05:46 | 
  <ebernhardson@deploy1001> | 
  Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | 
  [production] | 
            
  | 05:25 | 
  <ebernhardson@deploy1001> | 
  Finished deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest (duration: 00m 17s) | 
  [production] | 
            
  | 05:25 | 
  <ebernhardson@deploy1001> | 
  Started deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest | 
  [production] | 
            
  | 05:18 | 
  <legoktm@deploy1001> | 
  Synchronized php-1.33.0-wmf.13/extensions/JsonConfig/includes/JCCache.php:  Revert "JCCache: Explicit load the main slot to avoid API warnings" - T214179 (duration: 00m 58s) | 
  [production] | 
            
  
    | 
      
        2019-01-18
      
      §
     | 
  
    
  | 23:57 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 (duration: 01m 01s) | 
  [production] | 
            
  | 23:56 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 | 
  [production] | 
            
  | 23:55 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 (duration: 00m 18s) | 
  [production] | 
            
  | 23:54 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 | 
  [production] | 
            
  | 23:53 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 (duration: 00m 34s) | 
  [production] | 
            
  | 23:53 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 | 
  [production] | 
            
  | 20:47 | 
  <mobrovac> | 
  restbase/cassandra bootstrap restbase1016-c - T212418 | 
  [production] | 
            
  | 20:47 | 
  <mobrovac> | 
  restbase/cassandra bootstrap restbase1016-c | 
  [production] | 
            
  | 17:24 | 
  <godog> | 
  bootstrap cassandra-b on restbase1016 - T212418 | 
  [production] | 
            
  | 17:06 | 
  <marostegui> | 
  Reload haproxy on dbproxy1009 after rack a2 maintenance | 
  [production] | 
            
  | 16:14 | 
  <arturo> | 
  T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) | 
  [production] | 
            
  | 15:36 | 
  <moritzm> | 
  rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 15:27 | 
  <moritzm> | 
  rebooting elnath to pick up SSBD-enabled qemu | 
  [production] | 
            
  | 13:41 | 
  <marostegui> | 
  reload haproxy on dbproxy1004 | 
  [production] | 
            
  | 13:18 | 
  <godog> | 
  start cassandra-a on restbase1016 - T212418 | 
  [production] | 
            
  | 13:07 | 
  <mbsantos@deploy1001> | 
  Finished deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed (duration: 00m 45s) | 
  [production] | 
            
  | 13:06 | 
  <mbsantos@deploy1001> | 
  Started deploy [kartotherian/deploy@0d11a2b] (stretch): Updating stretch instance with latest code, maps1003 have wrong dependencies installed | 
  [production] | 
            
  | 12:50 | 
  <moritzm> | 
  uploaded ferm 2.4-1+wmf1 to buster-wikimedia (T213527) | 
  [production] | 
            
  | 11:46 | 
  <moritzm> | 
  copied prometheus-rsyslog-exporter from stretch-wikimedia to buster-wikimedia | 
  [production] | 
            
  | 11:09 | 
  <marostegui> | 
  Deploy schema change on db2039 (s6 codfw master) - T210713 | 
  [production] | 
            
  | 10:54 | 
  <marostegui> | 
  Deploy schema change on dbstore2001:3316 - T210713 | 
  [production] | 
            
  | 10:42 | 
  <jynus> | 
  killing and removing data from db1118 | 
  [production] | 
            
  | 10:41 | 
  <marostegui> | 
  Deploy schema change on db2076 - T210713 | 
  [production] | 
            
  | 10:29 | 
  <vgutierrez> | 
  restarting pybal in lvs2002 - T214072 | 
  [production] | 
            
  | 10:23 | 
  <marostegui> | 
  Deploy schema change on db2087:3316 - T210713 | 
  [production] | 
            
  | 10:23 | 
  <vgutierrez> | 
  restarting pybal in lvs2005 - T214072 | 
  [production] | 
            
  | 10:02 | 
  <marostegui> | 
  Add dbstore1003:3315 to zarcillo - T210478 | 
  [production] | 
            
  | 09:58 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1113:3315 - T210478 (duration: 00m 45s) | 
  [production] | 
            
  | 09:57 | 
  <marostegui> | 
  Add dbstore1003:3315 to tendril - T210478 | 
  [production] |