| 2017-02-02
      
      § | 
    
  | 23:51 | <twentyafterfour> | 1.29.0-wmf.10 appears to be stable. Train deployment complete. | [production] | 
            
  | 23:38 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 | [production] | 
            
  | 23:33 | <twentyafterfour@tin> | Synchronized php-1.29.0-wmf.10/includes/cache/MessageCache.php: deploy I5b84b1ae4a9c7b710ee452c61d7d9d6076ec9e6a refs T156996 (duration: 00m 45s) | [production] | 
            
  | 23:11 | <greg-g> | Gerrit: we'll be flushing session caches momentarily, sorry for the inconvenience | [production] | 
            
  | 21:50 | <gehel> | reimaging relforge1002.eqiad.wmnet | [production] | 
            
  | 20:35 | <mutante> | carbon - disabling puppet (to stop it from re-adding second IPv6 address causing issues with ferm rules) | [production] | 
            
  | 20:17 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.29.0-wmf.9 | [production] | 
            
  | 20:14 | <twentyafterfour> | rolling back to wmf.9 due to T156996 | [production] | 
            
  | 20:10 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 | [production] | 
            
  | 20:04 | <twentyafterfour> | deploying MediaWiki 1.29.0-wmf.10 to all wikis | [production] | 
            
  | 19:29 | <tgr> | reset wikimedia 2FA for jdlrobson | [production] | 
            
  | 19:24 | <tgr> | reset wikitech 2FA for jdlrobson | [production] | 
            
  | 19:13 | <hashar> | Gracefully restarting Jenkins | [production] | 
            
  | 19:09 | <ejegg> | updated fundraising tools from 931c8cf1db720723f90307f6a417184bd8c03bfc to 8a65e38807397d91a78f94cfb8013552d75d9772 | [production] | 
            
  | 19:03 | <ejegg> | re-enabled thank you mail job | [production] | 
            
  | 18:59 | <ejegg> | disabled thank you mail job | [production] | 
            
  | 18:04 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) (duration: 00m 51s) | [production] | 
            
  | 18:03 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@09101f7]: try previous deploy again (at least on canary) | [production] | 
            
  | 18:01 | <bearND> | ^ reverted previous deploy due to incorrect links in the news endpoint | [production] | 
            
  | 18:00 | <bsitzmann@tin> | Finished deploy [mobileapps/deploy@09101f7]: (no justification provided) (duration: 01m 56s) | [production] | 
            
  | 17:58 | <bsitzmann@tin> | Started deploy [mobileapps/deploy@09101f7]: (no justification provided) | [production] | 
            
  | 17:56 | <jynus> | upgrade & restart of db2059 T111654 | [production] | 
            
  | 17:43 | <jynus> | upgrade & restart of db2052 T111654 | [production] | 
            
  | 17:32 | <mobrovac> | restbase deploy end of 634faea2 | [production] | 
            
  | 17:08 | <mobrovac> | restbase deploying 634faea2 | [production] | 
            
  | 16:56 | <reedy@tin> | Synchronized php-1.29.0-wmf.10/extensions/ConfirmEdit/maintenance/GenerateFancyCaptchas.php: Fix inclusion path (duration: 00m 41s) | [production] | 
            
  | 16:24 | <elukey> | reboot mc2019->mc2025 to see if they come up cleanly (currently codfw replicas of eqiad redis shards) | [production] | 
            
  | 16:13 | <elukey> | rebooting mc202[6789] (not serving any traffic) to see if they come up cleanly | [production] | 
            
  | 16:00 | <elukey> | rebooting mc203[01234] (not serving any traffic) to see if they come up cleanly | [production] | 
            
  | 15:43 | <moritzm> | upgrading firejail on remaining app servers | [production] | 
            
  | 15:35 | <moritzm> | upgrading firejail on wtp1001 | [production] | 
            
  | 15:15 | <moritzm> | upgrading firejail on eqiad imagescalers | [production] | 
            
  | 15:11 | <elukey> | rebooting mc203[56] (not taking any traffic) to test if they come up cleanly | [production] | 
            
  | 15:01 | <elukey> | Replace Redis/Memcached shards mc200[4567] with mc202[2345] | [production] | 
            
  | 14:51 | <godog> | manually fail sdc on graphite1001 - T157022 | [production] | 
            
  | 14:23 | <addshore> | EU SWAT really finished | [production] | 
            
  | 14:23 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:334997|Create Wikiprojekti namespace on Finnish Wikipedia]] T156621 (duration: 00m 41s) | [production] | 
            
  | 14:14 | <addshore> | EU SWAT finished | [production] | 
            
  | 14:14 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:335481|Add Wikinews languages (en, pt, ca, fr, de, it) as import sources on eswikinews]] T156737 (duration: 00m 40s) | [production] | 
            
  | 14:10 | <addshore@tin> | Synchronized wmf-config/InitialiseSettings.php: SWAT [[gerrit:324489|Enable ElectronPdfService extension on dewiki]] T150942 (duration: 00m 41s) | [production] | 
            
  | 12:53 | <gehel> | starting reimage to jessie of elasticsearch relforge - T151326 | [production] | 
            
  | 11:59 | <joal@tin> | Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 01m 14s) | [production] | 
            
  | 11:58 | <joal@tin> | Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) | [production] | 
            
  | 11:40 | <elukey> | Swap mc2002 with mc2020, mc2003 with mc2021 (Redis codfw replicas) - T155755 | [production] | 
            
  | 11:35 | <joal@tin> | Finished deploy [analytics/refinery@bc4b4ed]: (no justification provided) (duration: 03m 03s) | [production] | 
            
  | 11:32 | <joal@tin> | Started deploy [analytics/refinery@bc4b4ed]: (no justification provided) | [production] | 
            
  | 10:53 | <elukey> | Swap mc2001 with mc2019 (Redis codfw replicas) - T155755 | [production] |