| 
      
        2018-07-17
      
      §
     | 
  
    
  | 11:03 | 
  <mobrovac@deploy1001> | 
  Finished deploy [restbase/deploy@622941d]: Expose the data/mobile/javascript end point, deduplicate most-read results and increase page/related response size to 20, take #2 - T199458 T195390 (duration: 19m 43s) | 
  [production] | 
            
  | 10:43 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@622941d]: Expose the data/mobile/javascript end point, deduplicate most-read results and increase page/related response size to 20, take #2 - T199458 T195390 | 
  [production] | 
            
  | 10:31 | 
  <moritzm> | 
  restarting archiva to pick up OpenJDK security update | 
  [production] | 
            
  | 10:31 | 
  <mobrovac@deploy1001> | 
  Started deploy [restbase/deploy@622941d]: Expose the data/mobile/javascript end point, deduplicate most-read results and increase page/related response size to 20 - T199458 T195390 | 
  [production] | 
            
  | 10:14 | 
  <marostegui> | 
  Deploy schema change on db1093 T144010 T51190 T199368 | 
  [production] | 
            
  | 10:08 | 
  <volans> | 
  reimage mw2224 to test the new stretch netboot and wmf-auto-reimage changes | 
  [production] | 
            
  | 10:07 | 
  <moritzm> | 
  restarting zookeeper in codfw to pick up Java security updates | 
  [production] | 
            
  | 09:41 | 
  <marostegui> | 
  Deploy schema change on db1113:3316 T144010 T51190 T199368 | 
  [production] | 
            
  | 09:38 | 
  <marostegui> | 
  Drop unused grants from db2037, db2042, db2078:3323, db2078:3325 | 
  [production] | 
            
  | 09:11 | 
  <marostegui> | 
  Deploy schema change on db1098:3316 T144010 T51190 T199368 | 
  [production] | 
            
  | 08:51 | 
  <moritzm> | 
  installing libipc-run-perl update from stretch 9.5 point release | 
  [production] | 
            
  | 08:31 | 
  <marostegui> | 
  Deploy schema change on db1096:3316 T144010 T51190 T199368 | 
  [production] | 
            
  | 07:50 | 
  <volans@deploy1001> | 
  Finished deploy [debmonitor/deploy@691d2f8]: Release v0.1.6 (duration: 00m 41s) | 
  [production] | 
            
  | 07:50 | 
  <volans@deploy1001> | 
  Started deploy [debmonitor/deploy@691d2f8]: Release v0.1.6 | 
  [production] | 
            
  | 07:29 | 
  <godog> | 
  un xfs_repair on filesystems reporting negative space available on ms-be1042 - T199198 | 
  [production] | 
            
  | 07:24 | 
  <moritzm> | 
  installing xapian-core security updates | 
  [production] | 
            
  | 07:17 | 
  <marostegui> | 
  Drop unused grants on es eqiad hosts | 
  [production] | 
            
  | 07:03 | 
  <moritzm> | 
  updated stretch netinst image for 9.5 | 
  [production] | 
            
  | 06:42 | 
  <moritzm> | 
  installing patch security updates | 
  [production] | 
            
  | 06:39 | 
  <moritzm> | 
  installing subversion security updates | 
  [production] | 
            
  | 06:32 | 
  <marostegui> | 
  Drop unused grants on es codfw hosts | 
  [production] | 
            
  | 06:30 | 
  <moritzm> | 
  installing postgresql-9.6 updates from stretch point release | 
  [production] | 
            
  | 05:55 | 
  <marostegui> | 
  Deploy schema change on db2039 (s6 codfw master) with replication, this will generate lag on codfw T144010 T51190 T199368 | 
  [production] | 
            
  | 05:37 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1100 after alter table (duration: 00m 49s) | 
  [production] | 
            
  | 05:34 | 
  <marostegui> | 
  Deploy schema change on db1070 (s5 primary master) T144010 T51190 T199368 | 
  [production] | 
            
  | 05:30 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1100 for alter table (duration: 00m 49s) | 
  [production] | 
            
  | 05:25 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1082 after alter table (duration: 00m 49s) | 
  [production] | 
            
  | 05:18 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1082 for alter table (duration: 00m 49s) | 
  [production] | 
            
  | 05:12 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 after alter table (duration: 00m 49s) | 
  [production] | 
            
  | 05:04 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 for alter table (duration: 00m 50s) | 
  [production] | 
            
  | 04:59 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 after alter table (duration: 00m 49s) | 
  [production] | 
            
  | 04:50 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 for alter table (duration: 00m 53s) | 
  [production] | 
            
  | 02:45 | 
  <l10nupdate@deploy1001> | 
  ResourceLoader cache refresh completed at Tue Jul 17 02:45:01 UTC 2018 (duration 10m 21s) | 
  [production] | 
            
  | 02:34 | 
  <l10nupdate@deploy1001> | 
  scap sync-l10n completed (1.32.0-wmf.12) (duration: 13m 51s) | 
  [production] | 
            
  
    | 
      
        2018-07-16
      
      §
     | 
  
    
  | 20:57 | 
  <ejegg> | 
  re-enabled payments listener failmail stream | 
  [production] | 
            
  | 20:11 | 
  <bsitzmann@deploy1001> | 
  Finished deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) (duration: 09m 01s) | 
  [production] | 
            
  | 20:02 | 
  <bsitzmann@deploy1001> | 
  Started deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) | 
  [production] | 
            
  | 18:35 | 
  <mepps> | 
  updated payments-wiki config to 4e0c6c3cfd | 
  [production] | 
            
  | 18:10 | 
  <niharika29@deploy1001> | 
  Synchronized wmf-config/: Rollout Watchlist Structured Filters to all wikis T181193 (duration: 00m 51s) | 
  [production] | 
            
  | 14:54 | 
  <moritzm> | 
  installing openssh updates from stretch point release | 
  [production] | 
            
  | 14:52 | 
  <marostegui> | 
  Change expire_log_days on db1067 - https://phabricator.wikimedia.org/T197069 | 
  [production] | 
            
  | 14:49 | 
  <marostegui> | 
  Drop unused ceilometer database from db1073 | 
  [production] | 
            
  | 14:47 | 
  <marostegui> | 
  Remove unused grants from db1073 | 
  [production] | 
            
  | 14:39 | 
  <marostegui> | 
  Remove unused grants from labsdb1004 and labsdb1005 | 
  [production] | 
            
  | 14:37 | 
  <marostegui> | 
  Remove unused grants from es2019 | 
  [production] | 
            
  | 14:27 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Repool db2076 (duration: 00m 49s) | 
  [production] | 
            
  | 14:24 | 
  <anomie@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 49s) | 
  [production] | 
            
  | 14:22 | 
  <anomie@deploy1001> | 
  Synchronized wmf-config/InitialiseSettings.php: Explicitly set wgMultiContentRevisionSchemaMigrationStage to current default (T174044) (duration: 00m 50s) | 
  [production] | 
            
  | 13:59 | 
  <marostegui> | 
  Stop replication on db2076 (db2095's master) | 
  [production] | 
            
  | 13:51 | 
  <marostegui@deploy1001> | 
  Synchronized wmf-config/db-codfw.php: Depool db2076 for maintenance (duration: 00m 50s) | 
  [production] |