| 2017-02-03
      
      § | 
    
  | 14:35 | <chasemp> | restart apache on graphite1001 to see if it helps sqlite lock isssue | [production] | 
            
  | 14:30 | <jynus> | upgrade and restart db2061 T111654 | [production] | 
            
  | 14:26 | <jynus@tin> | Synchronized wmf-config/db-codfw.php: Depool db2061 (duration: 00m 40s) | [production] | 
            
  | 13:58 | <jynus> | restarting and upgrading db2041 T111654 | [production] | 
            
  | 12:16 | <gehel> | restarting relforge1001 to pick up new master configuration | [production] | 
            
  | 11:21 | <jynus> | preparing to reimage db2054 T111654 | [production] | 
            
  | 11:01 | <marostegui> | Alter table metawiki.pagelinks on db1039 (depooled) - T153300 | [production] | 
            
  | 10:54 | <jynus> | preparing to reimage db2053 T111654 | [production] | 
            
  | 10:50 | <moritzm> | mwdebug* and mw1261 have been reverted to previous HHVM package | [production] | 
            
  | 10:19 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Repool db1064 - T153743 (duration: 00m 42s) | [production] | 
            
  | 10:04 | <marostegui> | Reboot db1064 to pick up the new kernels T153743 | [production] | 
            
  | 09:59 | <marostegui> | Upgrade db1064 from MariaDB 10.0.23 to 10.0.29 - T153743 | [production] | 
            
  | 09:55 | <gehel> | restarting relforge1002 to pick up new master configuration | [production] | 
            
  | 09:54 | <jynus> | upgrade & restart of db2063 T111654 | [production] | 
            
  | 09:48 | <marostegui> | Restart mysql on db1064 to get its binary log changed to ROW - T153743 | [production] | 
            
  | 09:42 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Depool db1064 - T153743 (duration: 00m 40s) | [production] | 
            
  | 09:41 | <marostegui@tin> | Synchronized wmf-config/db-codfw.php: Depool db1064 - T153743 (duration: 00m 40s) | [production] | 
            
  | 09:39 | <moritzm> | upgraded mwdebug* and mw1261 to the new HHVM package | [production] | 
            
  | 09:22 | <moritzm> | uploaded hhvm_3.12.11+dfsg-1+wmf2 to apt.wikimedia.org | [production] | 
            
  | 09:10 | <elukey> | Replace Redis/Memcached shards mc2008->2011 with mc2026->mc2029 | [production] | 
            
  | 08:50 | <moritzm> | installing tomcat regression updates on trusty hosts (jessie update was fine) | [production] | 
            
  | 08:15 | <moritzm> | restarting prometheus servers to pick up openssl update | [production] | 
            
  | 08:05 | <elukey> | bootstrapping aqs1008-b (AQS Cassandra instance) | [production] | 
            
  | 07:41 | <moritzm> | upgrading firejail on remaining wtp/Parsoid hosts | [production] | 
            
  | 07:15 | <marostegui> | Stop MySQL db1095 to snapshot it to es1013:/srv/tmp - T153743 | [production] | 
            
  | 02:38 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Fri Feb  3 02:38:10 UTC 2017 (duration 5m 3s) | [production] | 
            
  | 02:33 | <l10nupdate@tin> | scap sync-l10n completed (1.29.0-wmf.10) (duration: 12m 06s) | [production] | 
            
  | 00:51 | <dereckson@tin> | Synchronized dblists/related-articles-footer-blacklisted-skins.dblist: Adjust RelatedArticles deployment scale for Mobile English Wikipedia (T154681) (duration: 00m 39s) | [production] | 
            
  | 00:48 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings.php: Set site name for ku.wiktionary (T29878) (duration: 00m 39s) | [production] | 
            
  | 00:45 | <dereckson@tin> | Synchronized wmf-config/: Adjust RelatedArticles deployment scale for Mobile English Wikipedia (T154681) (duration: 00m 42s) | [production] | 
            
  | 00:42 | <dereckson@tin> | Synchronized dblists/related-articles-footer-blacklisted-skins.dblist: Enable RelatedArticles on Mobile French Wikipedia (T156362) (duration: 00m 44s) | [production] | 
            
  | 00:33 | <dereckson@tin> | Synchronized static/apple-touch/wikipedia.png: Update apple touch icon for Wikipedia (T152538) (duration: 00m 39s) | [production] | 
            
  | 00:24 | <dereckson@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: Limit page images on beta cluster to images in the lead section (no-op in prod) (duration: 00m 41s) | [production] | 
            
  | 00:17 | <dereckson@tin> | Synchronized wmf-config/interwiki.php: Interwiki map update (duration: 00m 40s) | [production] | 
            
  
    | 2017-02-02
      
      § | 
    
  | 23:51 | <twentyafterfour> | 1.29.0-wmf.10 appears to be stable. Train deployment complete. | [production] | 
            
  | 23:38 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 | [production] | 
            
  | 23:33 | <twentyafterfour@tin> | Synchronized php-1.29.0-wmf.10/includes/cache/MessageCache.php: deploy I5b84b1ae4a9c7b710ee452c61d7d9d6076ec9e6a refs T156996 (duration: 00m 45s) | [production] | 
            
  | 23:11 | <greg-g> | Gerrit: we'll be flushing session caches momentarily, sorry for the inconvenience | [production] | 
            
  | 21:50 | <gehel> | reimaging relforge1002.eqiad.wmnet | [production] | 
            
  | 20:35 | <mutante> | carbon - disabling puppet (to stop it from re-adding second IPv6 address causing issues with ferm rules) | [production] | 
            
  | 20:17 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: group2 wikis to 1.29.0-wmf.9 | [production] | 
            
  | 20:14 | <twentyafterfour> | rolling back to wmf.9 due to T156996 | [production] | 
            
  | 20:10 | <twentyafterfour@tin> | rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.29.0-wmf.10 | [production] | 
            
  | 20:04 | <twentyafterfour> | deploying MediaWiki 1.29.0-wmf.10 to all wikis | [production] | 
            
  | 19:29 | <tgr> | reset wikimedia 2FA for jdlrobson | [production] | 
            
  | 19:24 | <tgr> | reset wikitech 2FA for jdlrobson | [production] | 
            
  | 19:13 | <hashar> | Gracefully restarting Jenkins | [production] | 
            
  | 19:09 | <ejegg> | updated fundraising tools from 931c8cf1db720723f90307f6a417184bd8c03bfc to 8a65e38807397d91a78f94cfb8013552d75d9772 | [production] | 
            
  | 19:03 | <ejegg> | re-enabled thank you mail job | [production] | 
            
  | 18:59 | <ejegg> | disabled thank you mail job | [production] |