| 2018-07-17
      
      § | 
    
  | 10:08 | <volans> | reimage mw2224 to test the new stretch netboot and wmf-auto-reimage changes | [production] | 
            
  | 10:07 | <moritzm> | restarting zookeeper in codfw to pick up Java security updates | [production] | 
            
  | 09:41 | <marostegui> | Deploy schema change on db1113:3316 T144010 T51190 T199368 | [production] | 
            
  | 09:38 | <marostegui> | Drop unused grants from db2037, db2042, db2078:3323, db2078:3325 | [production] | 
            
  | 09:11 | <marostegui> | Deploy schema change on db1098:3316 T144010 T51190 T199368 | [production] | 
            
  | 08:51 | <moritzm> | installing libipc-run-perl update from stretch 9.5 point release | [production] | 
            
  | 08:31 | <marostegui> | Deploy schema change on db1096:3316 T144010 T51190 T199368 | [production] | 
            
  | 07:50 | <volans@deploy1001> | Finished deploy [debmonitor/deploy@691d2f8]: Release v0.1.6 (duration: 00m 41s) | [production] | 
            
  | 07:50 | <volans@deploy1001> | Started deploy [debmonitor/deploy@691d2f8]: Release v0.1.6 | [production] | 
            
  | 07:29 | <godog> | un xfs_repair on filesystems reporting negative space available on ms-be1042 - T199198 | [production] | 
            
  | 07:24 | <moritzm> | installing xapian-core security updates | [production] | 
            
  | 07:17 | <marostegui> | Drop unused grants on es eqiad hosts | [production] | 
            
  | 07:03 | <moritzm> | updated stretch netinst image for 9.5 | [production] | 
            
  | 06:42 | <moritzm> | installing patch security updates | [production] | 
            
  | 06:39 | <moritzm> | installing subversion security updates | [production] | 
            
  | 06:32 | <marostegui> | Drop unused grants on es codfw hosts | [production] | 
            
  | 06:30 | <moritzm> | installing postgresql-9.6 updates from stretch point release | [production] | 
            
  | 05:55 | <marostegui> | Deploy schema change on db2039 (s6 codfw master) with replication, this will generate lag on codfw T144010 T51190 T199368 | [production] | 
            
  | 05:37 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1100 after alter table (duration: 00m 49s) | [production] | 
            
  | 05:34 | <marostegui> | Deploy schema change on db1070 (s5 primary master) T144010 T51190 T199368 | [production] | 
            
  | 05:30 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1100 for alter table (duration: 00m 49s) | [production] | 
            
  | 05:25 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1082 after alter table (duration: 00m 49s) | [production] | 
            
  | 05:18 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1082 for alter table (duration: 00m 49s) | [production] | 
            
  | 05:12 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1097:3315 after alter table (duration: 00m 49s) | [production] | 
            
  | 05:04 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1097:3315 for alter table (duration: 00m 50s) | [production] | 
            
  | 04:59 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1096:3315 after alter table (duration: 00m 49s) | [production] | 
            
  | 04:50 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1096:3315 for alter table (duration: 00m 53s) | [production] | 
            
  | 02:45 | <l10nupdate@deploy1001> | ResourceLoader cache refresh completed at Tue Jul 17 02:45:01 UTC 2018 (duration 10m 21s) | [production] | 
            
  | 02:34 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.12) (duration: 13m 51s) | [production] | 
            
  
    | 2018-07-16
      
      § | 
    
  | 20:57 | <ejegg> | re-enabled payments listener failmail stream | [production] | 
            
  | 20:11 | <bsitzmann@deploy1001> | Finished deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) (duration: 09m 01s) | [production] | 
            
  | 20:02 | <bsitzmann@deploy1001> | Started deploy [mobileapps/deploy@fcae441]: Update mobileapps to bed7b29 (T174809) | [production] | 
            
  | 18:35 | <mepps> | updated payments-wiki config to 4e0c6c3cfd | [production] | 
            
  | 18:10 | <niharika29@deploy1001> | Synchronized wmf-config/: Rollout Watchlist Structured Filters to all wikis T181193 (duration: 00m 51s) | [production] | 
            
  | 14:54 | <moritzm> | installing openssh updates from stretch point release | [production] | 
            
  | 14:52 | <marostegui> | Change expire_log_days on db1067 - https://phabricator.wikimedia.org/T197069 | [production] | 
            
  | 14:49 | <marostegui> | Drop unused ceilometer database from db1073 | [production] | 
            
  | 14:47 | <marostegui> | Remove unused grants from db1073 | [production] | 
            
  | 14:39 | <marostegui> | Remove unused grants from labsdb1004 and labsdb1005 | [production] | 
            
  | 14:37 | <marostegui> | Remove unused grants from es2019 | [production] | 
            
  | 14:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Repool db2076 (duration: 00m 49s) | [production] | 
            
  | 14:24 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 49s) | [production] | 
            
  | 14:22 | <anomie@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Explicitly set wgMultiContentRevisionSchemaMigrationStage to current default (T174044) (duration: 00m 50s) | [production] | 
            
  | 13:59 | <marostegui> | Stop replication on db2076 (db2095's master) | [production] | 
            
  | 13:51 | <marostegui@deploy1001> | Synchronized wmf-config/db-codfw.php: Depool db2076 for maintenance (duration: 00m 50s) | [production] | 
            
  | 12:31 | <moritzm> | rebooting mw2136 for microcode tests | [production] | 
            
  | 12:14 | <moritzm> | rebooting multatuli for microcode tests | [production] | 
            
  | 11:56 | <zeljkof> | EU SWAT finished | [production] | 
            
  | 11:55 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:445929|Create Reconstruction NS at frwikt (T199631)]] (duration: 00m 49s) | [production] | 
            
  | 11:38 | <vgutierrez> | power cycle cp3033 - T199677 | [production] |