| 2015-10-05
      
      § | 
    
  | 09:58 | <_joe_> | installing the new HHVM package to appservers | [production] | 
            
  | 09:50 | <_joe_> | rebooted mw1153, soft lockup due to bnx2 failure | [production] | 
            
  | 09:50 | <godog> | roll-restart cassandra in restbase codfw | [production] | 
            
  | 09:18 | <godog> | roll-restart cassandra on restbase test cluster | [production] | 
            
  | 09:15 | <godog> | stop puppet on restbase and maps in preparation for https://gerrit.wikimedia.org/r/#/c/242896/1 | [production] | 
            
  | 08:07 | <_joe_> | upgrading HHVM on all API appservers | [production] | 
            
  | 05:33 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Mon Oct  5 05:33:18 UTC 2015 (duration 33m 17s) | [production] | 
            
  | 02:33 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-05 02:33:57+00:00 | [production] | 
            
  | 02:29 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 25s) | [production] | 
            
  
    | 2015-10-02
      
      § | 
    
  | 22:46 | <mutante> | holmium: apt-get clean for a little disk space - /var/log/designate/designate-mdns.log is more than half the size of / - needs logrotate | [production] | 
            
  | 21:33 | <Krinkle> | mwscript cleanupRemovedModules.php --wiki zhwiktionary | [production] | 
            
  | 21:21 | <Krinkle> | mwscript cleanupRemovedModules.php --wiki testwikidatawiki | [production] | 
            
  | 21:15 | <Krinkle> | mwscript cleanupRemovedModules.php --wiki dewiki | [production] | 
            
  | 21:15 | <Krinkle> | mwscript cleanupRemovedModules.php --wiki nlwiki | [production] | 
            
  | 21:15 | <Krinkle> | mwscript cleanupRemovedModules.php --wiki test2wiki | [production] | 
            
  | 21:06 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: (no message) (duration: 00m 17s) | [production] | 
            
  | 18:39 | <ottomata> | kafka preferred-replica-election | [production] | 
            
  | 17:53 | <ori@tin> | Synchronized php-1.27.0-wmf.1/includes/resourceloader: I680f3fda66c5: Configure ResourceLoader-specific ObjectCache instance (duration: 00m 17s) | [production] | 
            
  | 17:53 | <ottomata> | rolling restart of all hadoop-yarn-nodemanagers to pick up python3 + spark fix | [production] | 
            
  | 17:12 | <ori@tin> | Synchronized wmf-config/CommonSettings.php: I8318fe892: Configure MultiWriteBagOStuff for ResourceLoader (duration: 00m 17s) | [production] | 
            
  | 16:29 | <ori> | deployed grafana 8e92884bae (with backport of upstream fb9f9548829f2d4cecf35cda933700e5c2fa1bd6) | [production] | 
            
  | 15:13 | <ori@tin> | Synchronized php-1.27.0-wmf.1/resources/src/mediawiki/mediawiki.js: I8029208: Don't clobber existing styles when adding more in IE9 (duration: 00m 17s) | [production] | 
            
  | 14:37 | <jynus> | providing extra grants to wiki db users for heartbeat monitoring | [production] | 
            
  | 14:32 | <Coren> | Change of NFS mount options in labs pushed - puppet may report failures to refresh the mounts (once) on instances; expected and harmless. | [production] | 
            
  | 11:03 | <moritzm> | installed rpcbind security updates on all Ubuntu servers which runs it (jessie was already updated, since the DSA was released earlier) | [production] | 
            
  | 10:53 | <jynus> | restarting HHVM on mw1130 | [production] | 
            
  | 08:45 | <hashar> | restarting Nodepool to take in account changes made to the logging configuration https://gerrit.wikimedia.org/r/#/c/240986/ | [production] | 
            
  | 06:07 | <l10nupdate@tin> | ResourceLoader cache refresh completed at Fri Oct  2 06:07:05 UTC 2015 (duration 7m 4s) | [production] | 
            
  | 02:42 | <tstarling@tin> | Synchronized php-1.27.0-wmf.1/extensions/ParsoidBatchAPI: stats (duration: 00m 17s) | [production] | 
            
  | 02:41 | <l10nupdate@tin> | LocalisationUpdate completed (1.27.0-wmf.1) at 2015-10-02 02:41:33+00:00 | [production] | 
            
  | 02:36 | <l10nupdate@tin> | Synchronized php-1.27.0-wmf.1/cache/l10n: l10nupdate for 1.27.0-wmf.1 (duration: 08m 04s) | [production] | 
            
  | 00:44 | <ori@tin> | Synchronized php-1.27.0-wmf.1/includes/resourceloader: I21bb3f08e7f and follow-ups (duration: 00m 18s) | [production] | 
            
  | 00:43 | <ori@tin> | Synchronized php-1.27.0-wmf.1/vendor: Add wikimedia/relpath 1.0.3 (duration: 00m 21s) | [production] |