| 
      
        2013-03-08
      
      §
     | 
  
    
  | 22:28 | 
  <logmsgbot_> | 
  reedy synchronized wmf-config/ | 
  [production] | 
            
  | 22:28 | 
  <logmsgbot_> | 
  py synchronized wmf-config/lucene-production.php  'moving pool4 and pool5 search traffic back to eqiad' | 
  [production] | 
            
  | 22:21 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf10/includes/Collation.php | 
  [production] | 
            
  | 21:47 | 
  <awight> | 
  payments cluster update to a6fe052a73 | 
  [production] | 
            
  | 20:29 | 
  <Ryan_Lane> | 
  enabling quorum feature for all gluster volumes | 
  [production] | 
            
  | 19:55 | 
  <RobH> | 
  authdns-update, why?  because i can. | 
  [production] | 
            
  | 19:34 | 
  <Ryan_Lane> | 
  added Babel extension to wikitech | 
  [production] | 
            
  | 19:20 | 
  <logmsgbot_> | 
  py synchronized wmf-config/db-pmtpa.php  'removing a second node per shard for streaming dumps. stopping slave' | 
  [production] | 
            
  | 15:34 | 
  <ottomata> | 
  adding metrics.wikimedia.org domain, running authdns-update on dobson | 
  [production] | 
            
  | 06:21 | 
  <Tim> | 
  updated luasandbox to version 1.4 (with pauseUsageTimer) | 
  [production] | 
            
  | 04:01 | 
  <logmsgbot_> | 
  reedy synchronized php-1.21wmf11/extensions/Translate | 
  [production] | 
            
  | 02:52 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.21wmf10) at Fri Mar  8 02:52:54 UTC 2013 | 
  [production] | 
            
  | 02:28 | 
  <logmsgbot_> | 
  LocalisationUpdate completed (1.21wmf11) at Fri Mar  8 02:28:34 UTC 2013 | 
  [production] | 
            
  | 01:27 | 
  <mutante> | 
  installing package upgrades on ekrem | 
  [production] | 
            
  | 01:12 | 
  <logmsgbot_> | 
  catrope synchronized wmf-config/InitialiseSettings.php  '20388a06 - Normalize VE config on testwiki' | 
  [production] | 
            
  | 00:56 | 
  <mutante> | 
  added Set(@ReferrerWhitelist, qw(rt.wikimedia.org:443 rt.wikimedia.org:80)); | 
  [production] | 
            
  | 00:55 | 
  <Ryan_Lane> | 
  deploying change 52592 to wikitech | 
  [production] | 
            
  | 00:55 | 
  <mutante> | 
  killall lighttpd and restart lighttpd and apache on streber | 
  [production] | 
            
  | 00:19 | 
  <logmsgbot_> | 
  kaldari Finished syncing Wikimedia installation... : | 
  [production] | 
            
  | 00:06 | 
  <mutante> | 
  installing openjdk/icedtea jre and other package upgrades on gallium (jenkins) | 
  [production] | 
            
  | 00:05 | 
  <LeslieCarr> | 
  upgrading cp1001 | 
  [production] | 
            
  
    | 
      
        2013-03-07
      
      §
     | 
  
    
  | 23:54 | 
  <logmsgbot_> | 
  kaldari Started syncing Wikimedia installation... : | 
  [production] | 
            
  | 23:47 | 
  <LeslieCarr> | 
  doing tmh upgrades | 
  [production] | 
            
  | 23:47 | 
  <mutante> | 
  bravely rebooting streber - expect short RT and Observium outage | 
  [production] | 
            
  | 23:25 | 
  <LeslieCarr> | 
  upgrading solr boxes | 
  [production] | 
            
  | 23:14 | 
  <mutante> | 
  installing kernel on streber | 
  [production] | 
            
  | 23:11 | 
  <^demon> | 
  gerrit: disabling hooks-its plugin for the time being. It's working (yay) but it's overly spammy until we fix it next week. | 
  [production] | 
            
  | 23:04 | 
  <LeslieCarr> | 
  dist-upgrading pmtpa memcache | 
  [production] | 
            
  | 23:04 | 
  <mutante> | 
  dist-upgrading zhen | 
  [production] | 
            
  | 22:38 | 
  <mutante> | 
  rebooting yvon | 
  [production] | 
            
  | 22:34 | 
  <mutante> | 
  installing package upgrades on yvon despite (defunct apt-get procs) | 
  [production] | 
            
  | 22:31 | 
  <mutante> | 
  salt pkg.upgrade on yvon | 
  [production] | 
            
  | 22:28 | 
  <Ryan_Lane> | 
  rebooting marmontel | 
  [production] | 
            
  | 22:25 | 
  <mutante> | 
  salt pkg.upgrade on spence | 
  [production] | 
            
  | 22:21 | 
  <mutante> | 
  salt pkg.upgrade on zirconium | 
  [production] | 
            
  | 22:18 | 
  <LeslieCarr> | 
  upgrading all analytics machiens | 
  [production] | 
            
  | 22:06 | 
  <mutante> | 
  reboot formey after dist-upgrade via salt | 
  [production] | 
            
  | 20:05 | 
  <logmsgbot_> | 
  catrope synchronized wmf-config/CommonSettings.php  'fa0a56a89 - parsoidcache VIP in pmtpa' | 
  [production] | 
            
  | 19:37 | 
  <logmsgbot_> | 
  bsitu synchronized wmf-config/CommonSettings.php  'Add Eventlogging configuration to Echo' | 
  [production] | 
            
  | 19:17 | 
  <logmsgbot_> | 
  pgehres synchronized php-1.21wmf11/extensions/CentralNotice/  'Updating CEntralNotice to master, resolving bug 45846' | 
  [production] | 
            
  | 18:41 | 
  <logmsgbot_> | 
  reedy synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 18:39 | 
  <logmsgbot_> | 
  reedy synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 17:36 | 
  <logmsgbot_> | 
  reedy synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 16:07 | 
  <cmjohnson1> | 
  reseating disk4 on ms-be1004 | 
  [production] | 
            
  | 15:28 | 
  <mark> | 
  Reinstalled cp3003 | 
  [production] |