| 2013-03-08
      
      § | 
    
  | 22:28 | <logmsgbot_> | reedy synchronized wmf-config/ | [production] | 
            
  | 22:28 | <logmsgbot_> | py synchronized wmf-config/lucene-production.php  'moving pool4 and pool5 search traffic back to eqiad' | [production] | 
            
  | 22:21 | <logmsgbot_> | reedy synchronized php-1.21wmf10/includes/Collation.php | [production] | 
            
  | 21:47 | <awight> | payments cluster update to a6fe052a73 | [production] | 
            
  | 20:29 | <Ryan_Lane> | enabling quorum feature for all gluster volumes | [production] | 
            
  | 19:55 | <RobH> | authdns-update, why?  because i can. | [production] | 
            
  | 19:34 | <Ryan_Lane> | added Babel extension to wikitech | [production] | 
            
  | 19:20 | <logmsgbot_> | py synchronized wmf-config/db-pmtpa.php  'removing a second node per shard for streaming dumps. stopping slave' | [production] | 
            
  | 15:34 | <ottomata> | adding metrics.wikimedia.org domain, running authdns-update on dobson | [production] | 
            
  | 06:21 | <Tim> | updated luasandbox to version 1.4 (with pauseUsageTimer) | [production] | 
            
  | 04:01 | <logmsgbot_> | reedy synchronized php-1.21wmf11/extensions/Translate | [production] | 
            
  | 02:52 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf10) at Fri Mar  8 02:52:54 UTC 2013 | [production] | 
            
  | 02:28 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf11) at Fri Mar  8 02:28:34 UTC 2013 | [production] | 
            
  | 01:27 | <mutante> | installing package upgrades on ekrem | [production] | 
            
  | 01:12 | <logmsgbot_> | catrope synchronized wmf-config/InitialiseSettings.php  '20388a06 - Normalize VE config on testwiki' | [production] | 
            
  | 00:56 | <mutante> | added Set(@ReferrerWhitelist, qw(rt.wikimedia.org:443 rt.wikimedia.org:80)); | [production] | 
            
  | 00:55 | <Ryan_Lane> | deploying change 52592 to wikitech | [production] | 
            
  | 00:55 | <mutante> | killall lighttpd and restart lighttpd and apache on streber | [production] | 
            
  | 00:19 | <logmsgbot_> | kaldari Finished syncing Wikimedia installation... : | [production] | 
            
  | 00:06 | <mutante> | installing openjdk/icedtea jre and other package upgrades on gallium (jenkins) | [production] | 
            
  | 00:05 | <LeslieCarr> | upgrading cp1001 | [production] | 
            
  
    | 2013-03-07
      
      § | 
    
  | 23:54 | <logmsgbot_> | kaldari Started syncing Wikimedia installation... : | [production] | 
            
  | 23:47 | <LeslieCarr> | doing tmh upgrades | [production] | 
            
  | 23:47 | <mutante> | bravely rebooting streber - expect short RT and Observium outage | [production] | 
            
  | 23:25 | <LeslieCarr> | upgrading solr boxes | [production] | 
            
  | 23:14 | <mutante> | installing kernel on streber | [production] | 
            
  | 23:11 | <^demon> | gerrit: disabling hooks-its plugin for the time being. It's working (yay) but it's overly spammy until we fix it next week. | [production] | 
            
  | 23:04 | <LeslieCarr> | dist-upgrading pmtpa memcache | [production] | 
            
  | 23:04 | <mutante> | dist-upgrading zhen | [production] | 
            
  | 22:38 | <mutante> | rebooting yvon | [production] | 
            
  | 22:34 | <mutante> | installing package upgrades on yvon despite (defunct apt-get procs) | [production] | 
            
  | 22:31 | <mutante> | salt pkg.upgrade on yvon | [production] | 
            
  | 22:28 | <Ryan_Lane> | rebooting marmontel | [production] | 
            
  | 22:25 | <mutante> | salt pkg.upgrade on spence | [production] | 
            
  | 22:21 | <mutante> | salt pkg.upgrade on zirconium | [production] | 
            
  | 22:18 | <LeslieCarr> | upgrading all analytics machiens | [production] | 
            
  | 22:06 | <mutante> | reboot formey after dist-upgrade via salt | [production] | 
            
  | 20:05 | <logmsgbot_> | catrope synchronized wmf-config/CommonSettings.php  'fa0a56a89 - parsoidcache VIP in pmtpa' | [production] | 
            
  | 19:37 | <logmsgbot_> | bsitu synchronized wmf-config/CommonSettings.php  'Add Eventlogging configuration to Echo' | [production] | 
            
  | 19:17 | <logmsgbot_> | pgehres synchronized php-1.21wmf11/extensions/CentralNotice/  'Updating CEntralNotice to master, resolving bug 45846' | [production] | 
            
  | 18:41 | <logmsgbot_> | reedy synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 18:39 | <logmsgbot_> | reedy synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 17:36 | <logmsgbot_> | reedy synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 16:07 | <cmjohnson1> | reseating disk4 on ms-be1004 | [production] | 
            
  | 15:28 | <mark> | Reinstalled cp3003 | [production] | 
            
  | 15:00 | <mark> | Restarted gmetad on nickel | [production] | 
            
  | 02:53 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf10) at Thu Mar  7 02:53:50 UTC 2013 | [production] | 
            
  | 02:29 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf11) at Thu Mar  7 02:29:38 UTC 2013 | [production] | 
            
  | 01:53 | <mutante> | installing package upgrades on sodium | [production] |