| 2018-07-19
      
      § | 
    
  | 11:40 | <zfilipin@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:446613|Enable Special:Block Feedback Request (T199919)]] (duration: 00m 55s) | [production] | 
            
  | 11:33 | <catrope@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: Enable Structured Discussions beta feature on orwiki (T199971) (duration: 00m 55s) | [production] | 
            
  | 11:22 | <volans> | testing reimage of californium (spare host) with the upgraded cumin | [production] | 
            
  | 11:20 | <chasemp> | maintain-views --all-databases --replace-all --table ores_classification --debug (labsdb) | [production] | 
            
  | 11:19 | <chasemp> | maintain-views --all-databases --replace-all --table ores_model --debug (labsdb) | [production] | 
            
  | 11:18 | <tgr@deploy1001> | Synchronized wmf-config/InitialiseSettings.php: enable TemplateStyles on enwiki, frwiki, zhwiki T197603 T191452 T189022 (duration: 00m 55s) | [production] | 
            
  | 10:59 | <volans> | upgrading cumin on sarin - T187773 | [production] | 
            
  | 10:52 | <legoktm> | made myself a crat on test2wiki | [production] | 
            
  | 10:06 | <moritzm> | installing file/libmagic security updates | [production] | 
            
  | 09:55 | <moritzm> | installing check-postgres update from stretch 9.5 point release | [production] | 
            
  | 09:49 | <aaron@deploy1001> | Synchronized php-1.32.0-wmf.13/includes/libs/objectcache/MultiWriteBagOStuff.php: 2cee0ab7085a74d35bc192ec8bc9cf461b286695 (duration: 00m 55s) | [production] | 
            
  | 09:35 | <volans> | cumin upgrade on labpuppetmaster* hosts completed - T187773 | [production] | 
            
  | 09:33 | <moritzm> | installing openssl security updates | [production] | 
            
  | 09:33 | <volans> | removed leftover cumin installation from labtestpuppetmaster2001 - T187773 | [production] | 
            
  | 09:27 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 09:27 | <godog> | run xfs_repair on filesystems reporting negative space available on ms-be1040 - T199198 | [production] | 
            
  | 09:24 | <moritzm> | installing tomcat7 security updates | [production] | 
            
  | 09:23 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Repool es1019 with low load (duration: 00m 54s) | [production] | 
            
  | 09:21 | <moritzm> | installing ant security updates | [production] | 
            
  | 09:14 | <moritzm> | uploaded jenkins 2.121.2 to apt.wikimedia.org (T199448) | [production] | 
            
  | 08:46 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 08:39 | <volans> | start upgrade of cumin to 3.0.1-1 on labpuppetmaster* - T187773 | [production] | 
            
  | 08:32 | <marostegui> | Deploy schema change on dbstore1002:s2 T144010 T51190 T199368 | [production] | 
            
  | 08:31 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 08:08 | <elukey> | restart eventstreams on scb2* hosts to pick up new Kafka settings (pointing it to main-codfw) - T199813 | [production] | 
            
  | 08:04 | <kartik@deploy1001> | Finished deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) (duration: 03m 58s) | [production] | 
            
  | 08:00 | <kartik@deploy1001> | Started deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) | [production] | 
            
  | 07:58 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 07:54 | <marostegui> | Deploy schema change on s2 codfw masters (db2035) this will generate lag on s2 codfw T144010 T51190 T199368 | [production] | 
            
  | 07:50 | <jynus> | stop es1019 and reimage it | [production] | 
            
  | 07:48 | <jynus@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool es1019 (duration: 00m 54s) | [production] | 
            
  | 07:43 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) | [production] | 
            
  | 07:26 | <moritzm> | removing cdrom and sr_mod (related module) kernel modules across the fleet (following the blacklisting of the kernel module via puppet) | [production] | 
            
  | 06:00 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 05:44 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) | [production] | 
            
  | 05:30 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3312 after MySQL upgrade (duration: 00m 54s) | [production] | 
            
  | 05:14 | <marostegui> | Stop MySQL on db1103 to upgrade MySQL | [production] | 
            
  | 05:11 | <marostegui@deploy1001> | Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for MySQL upgrade (duration: 00m 56s) | [production] | 
            
  | 04:12 | <kart_> | Finished ContentTranslation draft purge script on mwmaint1001 (T199658) | [production] | 
            
  | 04:05 | <kart_> | Starting ContentTranslation draft purge script on mwmaint1001, dry run first and then --really | [production] | 
            
  | 03:57 | <krinkle@deploy1001> | Synchronized wmf-config/CommonSettings.php: I978f3eda8 - Farewell temporary hack from 2013 (duration: 00m 56s) | [production] | 
            
  | 03:20 | <ejegg> | updated CiviCRM from b21d783e7f to 6f311f48d9 | [production] | 
            
  | 03:09 | <l10nupdate@deploy1001> | ResourceLoader cache refresh completed at Thu Jul 19 03:09:19 UTC 2018 (duration 10m 35s) | [production] | 
            
  | 02:58 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.13) (duration: 15m 05s) | [production] | 
            
  | 02:24 | <l10nupdate@deploy1001> | scap sync-l10n completed (1.32.0-wmf.12) (duration: 10m 41s) | [production] |