| 2018-01-05
      
      § | 
    
  | 09:30 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1098:3317 - T163190 (duration: 00m 27s) | [production] | 
            
  | 09:20 | <elukey> | drain and reboot analytics1030 for kernel updates | [production] | 
            
  | 09:11 | <godog> | reboot ms-be1014 to test update stretch kernel | [production] | 
            
  | 08:54 | <elukey> | ran git checkout modules/role/manifests/puppetmaster/standalone.pp on labs-puppetmaster.wikimedia.org to unblock sync from prod | [production] | 
            
  | 08:39 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1094 - T163190 (duration: 00m 28s) | [production] | 
            
  | 07:37 | <_joe_> | rebooting mw1276 toio, kernel upgrade | [production] | 
            
  | 07:25 | <_joe_> | rebooting mw1261 | [production] | 
            
  | 06:49 | <marostegui> | Stop replication in sync on db1039 and db1098:3317 - T163190 | [production] | 
            
  | 06:48 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1098:3317 - T163190 (duration: 00m 27s) | [production] | 
            
  | 06:24 | <marostegui> | Deploy schema change on db1094 - T174569 | [production] | 
            
  | 06:23 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1094 - T163190 (duration: 00m 51s) | [production] | 
            
  | 03:54 | <demon@tin> | Synchronized wmf-config/InitialiseSettings.php: Undeploy EducationProgram from test2wiki (duration: 00m 48s) | [production] | 
            
  
    | 2018-01-04
      
      § | 
    
  | 23:30 | <apergos> | rebooted releases1001 and 2001 (new kernel) | [production] | 
            
  | 22:09 | <moritzm> | uploaded linux-meta 1.16 for jessie-wikimedia to apt.wikimedia.org (which installs the new KPTI-enabled kernel with the new ABI) | [production] | 
            
  | 22:03 | <twentyafterfour@tin> | rebuilt and synchronized wikiversions files: all wikis to 1.31.0-wmf.15 | [production] | 
            
  | 22:00 | <twentyafterfour> | No blockers remain for T180748, proceeding to deploy wmf.15 to all wikis | [production] | 
            
  | 21:53 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.15/extensions/TitleBlacklist/TitleBlacklistPreAuthenticationProvider.php: Deploy 332fab0d737b5a524abbed7264d64890dd3ce6dc to stop logspam and unblock the train (duration: 01m 02s) | [production] | 
            
  | 21:37 | <moritzm> | uploaded linux-4.9.65-3+deb9u1~bpo8+2 for jessie-wikimedia to apt.wikimedia.org (provides KPTI backport) | [production] | 
            
  | 21:35 | <twentyafterfour@tin> | Synchronized php-1.31.0-wmf.15/includes/parser/Parser.php: Deploy 601cf9d183b0e5a97d264048efaab71a4a925500 (duration: 01m 03s) | [production] | 
            
  | 21:33 | <twentyafterfour> | deploying patches to unblock the train | [production] | 
            
  | 21:25 | <moritzm> | reboot multatuli for kernel update | [production] | 
            
  | 20:06 | <twentyafterfour> | There are still open blockers for wmf.15 - see T180748 .. attempting to resolve them to unblock the train. | [production] | 
            
  | 20:03 | <twentyafterfour> | preparing to deploy the train (filling in for no_justification) | [production] | 
            
  | 19:51 | <joal@tin> | Finished deploy [analytics/refinery@a69a2cd]: Regular analytics deploy (duration: 04m 38s) | [production] | 
            
  | 19:46 | <joal@tin> | Started deploy [analytics/refinery@a69a2cd]: Regular analytics deploy | [production] | 
            
  | 18:58 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) (duration: 06m 01s) | [production] | 
            
  | 18:52 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@8bcffa9]: Update mobileapps to a4ba9fd (T182330 T177430 T170690 T182652 T184198) | [production] | 
            
  | 18:27 | <jynus> | upgrade and restart labsdb1009 | [production] | 
            
  | 17:42 | <moritzm> | upgrading HHVM on eqiad video scalers to 3.18.6 | [production] | 
            
  | 17:40 | <demon@tin> | Finished deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin (duration: 00m 10s) | [production] | 
            
  | 17:40 | <demon@tin> | Started deploy [gerrit/gerrit@1e1a79d]: deploying hooks plugin | [production] | 
            
  | 16:38 | <jynus> | upgrade and restart db2089 (s5/s6) | [production] | 
            
  | 16:14 | <jynus> | upgrade and restart db2087 (s6/s7) | [production] | 
            
  | 15:44 | <jynus> | upgrade and restart db2076 | [production] | 
            
  | 15:36 | <jynus> | upgrade and restart db2067 | [production] | 
            
  | 15:31 | <demon@tin> | Synchronized php-1.31.0-wmf.15/extensions/ActiveAbstract/: unbreak, T184177 (duration: 01m 02s) | [production] | 
            
  | 15:17 | <jynus> | upgrade and restart db2060 | [production] | 
            
  | 15:09 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1101:3317 - T163190 (duration: 01m 02s) | [production] | 
            
  | 15:03 | <moritzm> | upgrading HHVM on eqiad image scalers to 3.18.6 | [production] | 
            
  | 14:54 | <jynus> | restart db2046 database to move socket location | [production] | 
            
  | 14:24 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Adding Movepage-summary to wgForceUIMsgAsContentMsg T183848 (duration: 01m 02s) | [production] | 
            
  | 14:11 | <niharika29@tin> | Synchronized wmf-config/InitialiseSettings.php: Restrict sending mails to new users T182541 (duration: 01m 02s) | [production] | 
            
  | 13:43 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1079 - T163190 (duration: 01m 01s) | [production] | 
            
  | 13:36 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1079 - T163190 (duration: 01m 02s) | [production] | 
            
  | 13:35 | <marostegui> | Stop replication in sync db1079 db1101:3317 T163190 | [production] | 
            
  | 13:17 | <moritzm> | upgrading HHVM on mw1180-mw1220 to 3.18.6 | [production] | 
            
  | 12:53 | <moritzm> | upgrading HHVM on mwdebug* to 3.18.6 | [production] | 
            
  | 12:45 | <mobrovac@tin> | Finished deploy [restbase/deploy@66b7efe]: Switch Mathoid to Cassandra 3 and drop Cassandra 2 references - T179419 (duration: 04m 05s) | [production] | 
            
  | 12:41 | <mobrovac@tin> | Started deploy [restbase/deploy@66b7efe]: Switch Mathoid to Cassandra 3 and drop Cassandra 2 references - T179419 | [production] | 
            
  | 12:07 | <mobrovac@tin> | Finished deploy [mathoid/deploy@c9957ce]: Mathoid v0.7.1 - T172767 (duration: 05m 05s) | [production] |