| 2018-06-27
      
      § | 
    
  | 17:53 | <mobrovac@deploy1001> | Finished deploy [proton/deploy@cd6ed94]: Update proton to 491e966 - T186748 T197856 (duration: 00m 35s) | [production] | 
            
  | 17:52 | <mobrovac@deploy1001> | Started deploy [proton/deploy@cd6ed94]: Update proton to 491e966 - T186748 T197856 | [production] | 
            
  | 16:39 | <marostegui> | Deploy schema change on dbstore1002:s8 T191316 T192926 T89737 T195193 | [production] | 
            
  | 15:38 | <thcipriani@deploy1001> | Synchronized README: Scap 3.8.3-1 noop test sync-file (duration: 00m 56s) | [production] | 
            
  | 15:36 | <marostegui> | Stop replication on db2094:3318 to update triggers on archive table | [production] | 
            
  | 15:30 | <godog> | upload scap 3.8.3 - T198277 | [production] | 
            
  | 14:51 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1067 (duration: 00m 56s) | [production] | 
            
  | 13:57 | <dcausse> | EU swat done | [production] | 
            
  | 13:42 | <dcausse@deploy1001> | Finished scap: wmf-config Add cirrussearch settings for wikibase (1/3) (duration: 05m 41s) | [production] | 
            
  | 13:40 | <moritzm> | uploaded debmonitor 0.1.5 to apt.wikimedia.org | [production] | 
            
  | 13:36 | <dcausse@deploy1001> | Started scap: wmf-config Add cirrussearch settings for wikibase (1/3) | [production] | 
            
  | 13:24 | <zfilipin@deploy1001> | Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:442146|Change FileImporter config data location (T198050)]] (duration: 00m 57s) | [production] | 
            
  | 13:07 | <elukey> | piwik upgraded to 3.2.1 on bohrium + started the db migration procedure (will last 2/3h probably) | [production] | 
            
  | 12:49 | <vgutierrez> | Upgrade librdkafka1 and restart varnishkafka-webrequest in cache::upload nodes - T182993 | [production] | 
            
  | 11:31 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1076 after alter table (duration: 00m 57s) | [production] | 
            
  | 11:26 | <marostegui> | Deploy schema change on s8 codfw master (db2045) with replication, this will generate lag on s8 codfw T191316 T192926 T89737 T195193 | [production] | 
            
  | 10:38 | <gehel> | removing maps-test2003 from cluster for reimage - T198290 | [production] | 
            
  | 10:36 | <volans@deploy1001> | Finished deploy [debmonitor/deploy@9536ebf]: CSP header hotfix (duration: 00m 22s) | [production] | 
            
  | 10:36 | <volans@deploy1001> | Started deploy [debmonitor/deploy@9536ebf]: CSP header hotfix | [production] | 
            
  | 10:24 | <marostegui> | Deploy schema change on db1076 T191316 T192926 T89737 T195193 | [production] | 
            
  | 10:24 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1076 for alter table (duration: 00m 56s) | [production] | 
            
  | 10:16 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1074 after alter table (duration: 00m 57s) | [production] | 
            
  | 10:11 | <jynus> | stopping db1067 and reimage it | [production] | 
            
  | 09:38 | <volans@deploy1001> | Finished deploy [debmonitor/deploy@052a9ea]: Release v0.1.5 (duration: 00m 24s) | [production] | 
            
  | 09:38 | <volans@deploy1001> | Started deploy [debmonitor/deploy@052a9ea]: Release v0.1.5 | [production] | 
            
  | 09:14 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1067 (duration: 00m 56s) | [production] | 
            
  | 08:35 | <marostegui> | Deploy schema change on db1074 with replication, this will generate lag on s2 on labsdb T191316 T192926 T89737 T195193 | [production] | 
            
  | 08:32 | <marostegui> | Stop replication on db1074 to remove triggers from db1125 - T192926 | [production] | 
            
  | 08:32 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1074 for alter table (duration: 00m 57s) | [production] | 
            
  | 08:26 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool db1090:3312 after alter table (duration: 00m 57s) | [production] | 
            
  | 07:58 | <vgutierrez> | Reinstall acamar & achernar as spare systems | [production] | 
            
  | 07:50 | <vgutierrez@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=dns4001.wikimedia.org | [production] | 
            
  | 07:38 | <vgutierrez@puppetmaster1001> | conftool action : set/pooled=no; selector: name=dns4001.wikimedia.org | [production] | 
            
  | 07:37 | <vgutierrez> | Depool dns4001 for server restart - T198215 | [production] | 
            
  | 05:08 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1090:3312 for alter table (duration: 01m 06s) | [production] | 
            
  | 05:08 | <marostegui> | Deploy schema change on db1090:3312 T191316 T192926 T89737 T195193 | [production] | 
            
  | 04:47 | <mholloway-shell@deploy1001> | Finished deploy [mobileapps/deploy@2207b66]: Update mobileapps to d7221ba (duration: 05m 42s) | [production] | 
            
  | 04:42 | <mholloway-shell@deploy1001> | Started deploy [mobileapps/deploy@2207b66]: Update mobileapps to d7221ba | [production] | 
            
  | 03:04 | <l10nupdate@deploy1001> | ResourceLoader cache refresh completed at Wed Jun 27 03:04:07 UTC 2018 (duration 10m 32s) | [production] | 
            
  | 02:53 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.10) (duration: 15m 53s) | [production] | 
            
  | 02:20 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.8) (duration: 08m 33s) | [production] | 
            
  
    | 2018-06-26
      
      § | 
    
  | 21:26 | <dduvall@deploy1001> | rebuilt and synchronized wikiversions files: Group0 to 1.32.0-wmf.10 | [production] | 
            
  | 21:18 | <dduvall@deploy1001> | Finished scap: testwiki to php-1.32.0-wmf.10 and rebuild l10n cache (duration: 22m 50s) | [production] | 
            
  | 20:55 | <dduvall@deploy1001> | Started scap: testwiki to php-1.32.0-wmf.10 and rebuild l10n cache | [production] | 
            
  | 20:47 | <marxarelli> | removing orphaned /srv/mediawiki/php-1.31.0-wmf.28 dir on deploy1001 | [production] | 
            
  | 20:38 | <volans> | regenerated debian installer for jessie 8.11 point release (released 3 days ago) | [production] | 
            
  | 20:34 | <marxarelli> | removed /srv/mediawiki/php-1.32.0-wmf.4 on mwdebug2002 to free disk space | [production] | 
            
  | 20:22 | <marxarelli> | manually cleaning up on mwdebug2002 due to full disk and scap failures | [production] | 
            
  | 20:21 | <dduvall@deploy1001> | Pruned MediaWiki: 1.32.0-wmf.4 [keeping static files] (duration: 03m 21s) | [production] | 
            
  | 19:43 | <marxarelli> | cdb-rebuild failed on mwdebug2002 due to lack of disk space | [production] |