| 
      
        2012-08-27
      
      §
     | 
  
    
  | 17:54 | 
  <Ryan_Lane> | 
  backing up all databases on virt0 | 
  [production] | 
            
  | 17:46 | 
  <Ryan_Lane> | 
  stopping rabbitmq on virt0 | 
  [production] | 
            
  | 17:43 | 
  <Ryan_Lane> | 
  disabling openstack services on the virt infrastructure, that is | 
  [production] | 
            
  | 17:43 | 
  <Ryan_Lane> | 
  disabling all openstack services | 
  [production] | 
            
  | 17:42 | 
  <Ryan_Lane> | 
  disabling OpenStackManager and LdapAuthentication on labsconsole | 
  [production] | 
            
  | 17:37 | 
  <Ryan_Lane> | 
  disabling puppet on all virt nodes | 
  [production] | 
            
  | 17:33 | 
  <paravoid> | 
  rolled back sq51's config; depooled sq51 (10' ago) | 
  [production] | 
            
  | 17:19 | 
  <paravoid> | 
  modified sq51 to serve origs from swift; added sq51 back to the pool | 
  [production] | 
            
  | 16:45 | 
  <paravoid> | 
  depooling sq51 backend | 
  [production] | 
            
  | 15:55 | 
  <paravoid> | 
  upgraded swift on ms-be12 | 
  [production] | 
            
  | 15:54 | 
  <paravoid> | 
  upgraded swift on ms-be5 | 
  [production] | 
            
  | 15:47 | 
  <paravoid> | 
  upgraded swift on ms-be11 | 
  [production] | 
            
  | 14:51 | 
  <paravoid> | 
  upgraded swift on ms-be3 | 
  [production] | 
            
  | 14:40 | 
  <paravoid> | 
  upgraded swift on ms-be4 | 
  [production] | 
            
  | 14:30 | 
  <paravoid> | 
  upgraded swift on ms-be10; (still depooled, no effect) | 
  [production] | 
            
  | 09:38 | 
  <mark> | 
  Decommissioning bayes, shut it down | 
  [production] | 
            
  | 02:52 | 
  <LocalisationUpdate> | 
  completed (1.20wmf9) at Mon Aug 27 02:52:23 UTC 2012 | 
  [production] | 
            
  | 02:27 | 
  <LocalisationUpdate> | 
  completed (1.20wmf10) at Mon Aug 27 02:27:16 UTC 2012 | 
  [production] | 
            
  | 02:16 | 
  <Tim> | 
  on spence: fixed /apache symlink, was pointing to a non-standard location, breaking sync scripts | 
  [production] | 
            
  | 01:32 | 
  <tstarling> | 
  synchronized php-1.20wmf10/extensions/Scribunto/engines/LuaCommon/LuaCommon.php  | 
  [production] | 
            
  | 01:32 | 
  <tstarling> | 
  synchronized php-1.20wmf10/extensions/Scribunto/Scribunto.i18n.php  | 
  [production] | 
            
  | 01:32 | 
  <Tim> | 
  updating Scribunto | 
  [production] | 
            
  | 01:31 | 
  <tstarling> | 
  synchronized php-1.20wmf10/extensions/Scribunto/Scribunto.namespaces.php  | 
  [production] | 
            
  
    | 
      
        2012-08-24
      
      §
     | 
  
    
  | 23:08 | 
  <notpeter> | 
  temp stopping puppet on iron | 
  [production] | 
            
  | 23:02 | 
  <maplebed> | 
  upgrading swift backend ms-be9 | 
  [production] | 
            
  | 22:15 | 
  <maplebed> | 
  upgrading swift backend ms-be7 | 
  [production] | 
            
  | 21:54 | 
  <maplebed> | 
  upgrading swift back end ms-be2 | 
  [production] | 
            
  | 21:30 | 
  <mutante> | 
  removing decom'ed srv206 and srv217 from ALL dsh groups | 
  [production] | 
            
  | 21:24 | 
  <maplebed> | 
  upgrading swift backend host ms-be1 | 
  [production] | 
            
  | 21:22 | 
  <mutante> | 
  breaking test.wp :) ..and rolling back | 
  [production] | 
            
  | 21:11 | 
  <maplebed> | 
  upgraded swift backend host ms-be8 | 
  [production] | 
            
  | 20:10 | 
  <dzahn> | 
  synchronized ./wmf-config/InitialiseSettings.php  | 
  [production] | 
            
  | 19:57 | 
  <dzahn> | 
  synchronized ./wmf-config/InitialiseSettings.php  | 
  [production] | 
            
  | 19:01 | 
  <RoanKattouw> | 
  (That was me) | 
  [production] | 
            
  | 19:01 | 
  <Restarted> | 
  logmsgbot, was broken again | 
  [production] | 
            
  | 19:00 | 
  <ottomata> | 
  starting puppet back up on brewster | 
  [production] | 
            
  | 18:58 | 
  <mutante> | 
  sync-file ./wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 18:57 | 
  <mutante> | 
  git pull in /h/w/common/wmf-config | 
  [production] | 
            
  | 18:32 | 
  <ottomata> | 
  temporarily stopping puppet on brewster to test out partman change for analytics1023-1027 | 
  [production] | 
            
  | 14:57 | 
  <RobH> | 
  restart puppeted on brewster | 
  [production] | 
            
  | 14:48 | 
  <RobH> | 
  analytics1023-1027 rotating down for removal of extra nic | 
  [production] | 
            
  | 14:28 | 
  <RobH> | 
  stopping puppet on brewster to do a local nonpuppetized test change | 
  [production] | 
            
  | 13:08 | 
  <paravoid> | 
  repooling ms-fe1/2 with all new swift | 
  [production] | 
            
  | 12:40 | 
  <apergos> | 
  on ms5, running from screen session as root: tossing non-standard thumb sizes > 100 px for commons/x/xx to see what space that gives us | 
  [production] | 
            
  | 12:32 | 
  <paravoid> | 
  depooling ms-fe1/2 for the 1.5 upgrade | 
  [production] | 
            
  | 02:47 | 
  <LocalisationUpdate> | 
  completed (1.20wmf9) at Fri Aug 24 02:47:46 UTC 2012 | 
  [production] |