| 2018-01-05
      
      § | 
    
  | 13:57 | <elukey@tin> | Finished deploy [analytics/aqs/deploy@792c95d]: Add pageviews by country endpoint (duration: 01m 12s) | [production] | 
            
  | 13:56 | <elukey@tin> | Started deploy [analytics/aqs/deploy@792c95d]: Add pageviews by country endpoint | [production] | 
            
  | 13:54 | <ema> | upgrade cp3046 to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 | [production] | 
            
  | 13:53 | <fdans@tin> | Finished deploy [analytics/aqs/deploy@792c95d]: (no justification provided) (duration: 00m 18s) | [production] | 
            
  | 13:52 | <fdans@tin> | Started deploy [analytics/aqs/deploy@792c95d]: (no justification provided) | [production] | 
            
  | 13:37 | <gehel> | rebooting wdqs1003 for kernel upgrade | [production] | 
            
  | 13:24 | <fdans@tin> | Finished deploy [analytics/aqs/deploy@792c95d]: (no justification provided) (duration: 01m 32s) | [production] | 
            
  | 13:22 | <fdans@tin> | Started deploy [analytics/aqs/deploy@792c95d]: (no justification provided) | [production] | 
            
  | 13:22 | <gehel> | rebooting elastic1017 for kernel upgrade | [production] | 
            
  | 13:19 | <fdans> | deploying Analytics Query Service | [production] | 
            
  | 12:44 | <elukey> | reboot kafka-jumbo1001 for kernel updates | [production] | 
            
  | 12:43 | <ema> | upgrade cp3007 to latest jessie point release (8.10) T182656 and linux kernel 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 | [production] | 
            
  | 12:04 | <jynus> | upgrade and restart labsdb1011 | [production] | 
            
  | 12:03 | <ema> | reboot cp1008 into linux 4.9.65-3+deb9u1~bpo8+2 (KPTI) T184267 | [production] | 
            
  | 10:15 | <godog> | reboot restbase2004 to test kernel upgrade | [production] | 
            
  | 10:14 | <jynus> | reboot labsdb1009 | [production] | 
            
  | 09:30 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 - T163190 (duration: 00m 27s) | [production] | 
            
  | 09:20 | <elukey> | drain and reboot analytics1030 for kernel updates | [production] | 
            
  | 09:11 | <godog> | reboot ms-be1014 to test update stretch kernel | [production] | 
            
  | 08:54 | <elukey> | ran git checkout modules/role/manifests/puppetmaster/standalone.pp on labs-puppetmaster.wikimedia.org to unblock sync from prod | [production] | 
            
  | 08:39 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1094 - T163190 (duration: 00m 28s) | [production] | 
            
  | 07:37 | <_joe_> | rebooting mw1276 toio, kernel upgrade | [production] | 
            
  | 07:25 | <_joe_> | rebooting mw1261 | [production] | 
            
  | 06:49 | <marostegui> | Stop replication in sync on db1039 and db1098:3317 - T163190 | [production] | 
            
  | 06:48 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 - T163190 (duration: 00m 27s) | [production] | 
            
  | 06:24 | <marostegui> | Deploy schema change on db1094 - T174569 | [production] | 
            
  | 06:23 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1094 - T163190 (duration: 00m 51s) | [production] | 
            
  | 03:54 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: Undeploy EducationProgram from test2wiki (duration: 00m 48s) | [production] | 
            
  
    | 2018-01-04
      
      § | 
    
  | 23:30 | <apergos> | rebooted releases1001 and 2001 (new kernel) | [production] | 
            
  | 22:09 | <moritzm> | uploaded linux-meta 1.16 for jessie-wikimedia to apt.wikimedia.org (which installs the new KPTI-enabled kernel with the new ABI) | [production] | 
            
  | 22:03 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.15 | [production] | 
            
  | 22:00 | <twentyafterfour> | No blockers remain for T180748, proceeding to deploy wmf.15 to all wikis | [production] | 
            
  | 21:53 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.15/extensions/TitleBlacklist/TitleBlacklistPreAuthenticationProvider.php: Deploy 332fab0d737b5a524abbed7264d64890dd3ce6dc to stop logspam and unblock the train (duration: 01m 02s) | [production] | 
            
  | 21:37 | <moritzm> | uploaded linux-4.9.65-3+deb9u1~bpo8+2 for jessie-wikimedia to apt.wikimedia.org (provides KPTI backport) | [production] | 
            
  | 21:35 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.15/includes/parser/Parser.php: Deploy 601cf9d183b0e5a97d264048efaab71a4a925500 (duration: 01m 03s) | [production] | 
            
  | 21:33 | <twentyafterfour> | deploying patches to unblock the train | [production] | 
            
  | 21:25 | <moritzm> | reboot multatuli for kernel update | [production] | 
            
  | 20:06 | <twentyafterfour> | There are still open blockers for wmf.15 - see T180748 .. attempting to resolve them to unblock the train. | [production] | 
            
  | 20:03 | <twentyafterfour> | preparing to deploy the train (filling in for no_justification) | [production] | 
            
  | 19:51 | <joal@tin> | Finished deploy [analytics/refinery@a69a2cd]: Regular analytics deploy (duration: 04m 38s) | [production] | 
            
  | 19:46 | <joal@tin> | Started deploy [analytics/refinery@a69a2cd]: Regular analytics deploy | [production] | 
            
  | 18:58 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) (duration: 06m 01s) | [production] | 
            
  | 18:52 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) | [production] | 
            
  | 18:27 | <jynus> | upgrade and restart labsdb1009 | [production] | 
            
  | 17:42 | <moritzm> | upgrading HHVM on eqiad video scalers to 3.18.6 | [production] | 
            
  | 17:40 | <demon@tin> | Finished deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin (duration: 00m 10s) | [production] | 
            
  | 17:40 | <demon@tin> | Started deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin | [production] | 
            
  | 16:38 | <jynus> | upgrade and restart db2089 (s5/s6) | [production] | 
            
  | 16:14 | <jynus> | upgrade and restart db2087 (s6/s7) | [production] | 
            
  | 15:44 | <jynus> | upgrade and restart db2076 | [production] |