| 2019-01-21
      
      § | 
    
  | 10:19 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Fully repool db1089 (duration: 00m 45s) | [production] | 
            
  | 09:57 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Give more traffic to db1089 (duration: 00m 45s) | [production] | 
            
  | 09:42 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly Repool db1089 T210478 (duration: 00m 45s) | [production] | 
            
  | 09:30 | <marostegui> | Compress a few tables on dbstore1003:3315 - T210478 | [production] | 
            
  | 08:35 | <marostegui> | Stop replication db1077 to deploy schema change - T85757 | [production] | 
            
  | 08:31 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1077 - T85757 (duration: 00m 46s) | [production] | 
            
  | 08:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1123 - T85757 (duration: 00m 48s) | [production] | 
            
  | 08:10 | <moritzm> | installing OpenSSL security updates | [production] | 
            
  | 07:39 | <marostegui> | Stop replication on db1124:3313 to fix triggers - T85757 | [production] | 
            
  | 07:00 | <marostegui> | Stop MySQL on db1089 to clone dbstore1003 - T210478 | [production] | 
            
  | 07:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1089 T210478 (duration: 00m 47s) | [production] | 
            
  | 06:54 | <marostegui> | Deploy schema change on db1123 - T85757 | [production] | 
            
  | 06:54 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1123 - T85757 (duration: 00m 50s) | [production] | 
            
  | 06:47 | <marostegui> | Drop tag_summary table from db1023, db1077, db1075 and db1078 T212255 | [production] | 
            
  | 06:45 | <vgutierrez@puppetmaster1001> | conftool action : set/pooled=no; selector: name=cp5010.eqsin.wmnet | [production] | 
            
  | 06:32 | <marostegui> | Drop tag_summary table from db1095:3313 - T212255 | [production] | 
            
  | 06:27 | <marostegui> | Drop tag_summary table from dbstore1002:s3 - T212255 | [production] | 
            
  | 06:12 | <marostegui> | Drop tag_summary table from s3 codfw - T212255 | [production] | 
            
  | 06:08 | <marostegui> | tag_summary table from s8 - T212255 | [production] | 
            
  
    | 2019-01-19
      
      § | 
    
  | 22:12 | <ariel@deploy1001> | Finished deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression (duration: 00m 03s) | [production] | 
            
  | 22:12 | <ariel@deploy1001> | Started deploy [dumps/dumps@ab79bbb]: multistream dumps in parallel, recombine gz and multistream without decompression | [production] | 
            
  | 20:34 | <gtirloni> | upgraded and rebooted labstore200{3,4} | [production] | 
            
  | 12:34 | <onimisionipe> | pool maps1003 - stretch migration is complete T198622 | [production] | 
            
  | 12:08 | <elukey> | run 'start all slaves' on dbstore1002 after crash | [production] | 
            
  | 08:42 | <marostegui> | Fixing dbstore1002 x1 replication T213670 | [production] | 
            
  | 07:36 | <elukey> | restart pdfrender on scb1004 | [production] | 
            
  | 05:55 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 14s) | [production] | 
            
  | 05:55 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | [production] | 
            
  | 05:55 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 15s) | [production] | 
            
  | 05:55 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | [production] | 
            
  | 05:46 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step (duration: 00m 13s) | [production] | 
            
  | 05:46 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@af21320]: test swapping venv build to scap fetch/script step | [production] | 
            
  | 05:25 | <ebernhardson@deploy1001> | Finished deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest (duration: 00m 17s) | [production] | 
            
  | 05:25 | <ebernhardson@deploy1001> | Started deploy [wikimedia/discovery/analytics@af21320]: bump discovery analytics to latest | [production] | 
            
  | 05:18 | <legoktm@deploy1001> | Synchronized php-1.33.0-wmf.13/extensions/JsonConfig/includes/JCCache.php:  Revert "JCCache: Explicit load the main slot to avoid API warnings" - T214179 (duration: 00m 58s) | [production] | 
            
  
    | 2019-01-18
      
      § | 
    
  | 23:57 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 (duration: 01m 01s) | [production] | 
            
  | 23:56 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #3 | [production] | 
            
  | 23:55 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 (duration: 00m 18s) | [production] | 
            
  | 23:54 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation), take #2 | [production] | 
            
  | 23:53 | <mobrovac@deploy1001> | Finished deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 (duration: 00m 34s) | [production] | 
            
  | 23:53 | <mobrovac@deploy1001> | Started deploy [restbase/deploy@f24d681]: Deploy latest version to restbase1016 (was out of rotation) - T212418 | [production] | 
            
  | 20:47 | <mobrovac> | restbase/cassandra bootstrap restbase1016-c - T212418 | [production] | 
            
  | 20:47 | <mobrovac> | restbase/cassandra bootstrap restbase1016-c | [production] | 
            
  | 17:24 | <godog> | bootstrap cassandra-b on restbase1016 - T212418 | [production] | 
            
  | 17:06 | <marostegui> | Reload haproxy on dbproxy1009 after rack a2 maintenance | [production] | 
            
  | 16:14 | <arturo> | T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch) | [production] | 
            
  | 15:36 | <moritzm> | rebooting mwdebug servers in codfw to pick up SSBD-enabled qemu | [production] | 
            
  | 15:27 | <moritzm> | rebooting elnath to pick up SSBD-enabled qemu | [production] |