| 
      
        2013-05-16
      
      §
     | 
  
    
  | 07:29 | 
  <maxsem> | 
  synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/includes/PageRenderingHooks.php | 
  [production] | 
            
  | 06:41 | 
  <yurik> | 
  synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/includes/PageRenderingHooks.php | 
  [production] | 
            
  | 02:30 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Thu May 16 02:30:28 UTC 2013 | 
  [production] | 
            
  | 02:12 | 
  <LocalisationUpdate> | 
  completed (1.22wmf3) at Thu May 16 02:11:55 UTC 2013 | 
  [production] | 
            
  | 02:06 | 
  <LocalisationUpdate> | 
  completed (1.22wmf4) at Thu May 16 02:06:34 UTC 2013 | 
  [production] | 
            
  | 00:36 | 
  <mutante> | 
  puppetstoredconfigclean.rb ocg3.pmtpa.wmnet | 
  [production] | 
            
  | 00:13 | 
  <mutante> | 
  puppetstoredconfigclean.rb ms2.pmtpa.wmnet | 
  [production] | 
            
  | 00:06 | 
  <reedy> | 
  synchronized database lists files: | 
  [production] | 
            
  | 00:04 | 
  <reedy> | 
  synchronized database lists files: | 
  [production] | 
            
  
    | 
      
        2013-05-15
      
      §
     | 
  
    
  | 23:44 | 
  <mutante> | 
  pushing wikimedia-task-appserver 2.9-1 | 
  [production] | 
            
  | 23:32 | 
  <reedy> | 
  synchronized database lists files: | 
  [production] | 
            
  | 23:29 | 
  <reedy> | 
  synchronized database lists files: | 
  [production] | 
            
  | 22:29 | 
  <krinkle> | 
  synchronized php-1.22wmf4/resources/mediawiki/mediawiki.js  'touched' | 
  [production] | 
            
  | 22:00 | 
  <yurik> | 
  synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/includes/PageRenderingHooks.php | 
  [production] | 
            
  | 21:53 | 
  <yurik> | 
  synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/includes/PageRenderingHooks.php | 
  [production] | 
            
  | 20:56 | 
  <Ryan_Lane> | 
  OpenStackManager is reenabled on virt0. login to wikitech is working again | 
  [production] | 
            
  | 20:55 | 
  <Ryan_Lane> | 
  openstack in pmtpa now at the folsom release | 
  [production] | 
            
  | 20:54 | 
  <maxsem> | 
  synchronized php-1.22wmf3/extensions/MobileFrontend/ | 
  [production] | 
            
  | 20:51 | 
  <maxsem> | 
  synchronized php-1.22wmf4/extensions/MobileFrontend/ | 
  [production] | 
            
  | 20:14 | 
  <Ryan_Lane> | 
  force running puppet on all virt nodes to bring them back up | 
  [production] | 
            
  | 20:14 | 
  <Ryan_Lane> | 
  upgrading schema for keystone, then glance, then nova | 
  [production] | 
            
  | 20:12 | 
  <Ryan_Lane> | 
  backing up keystone, nova, and glance databases | 
  [production] | 
            
  | 20:12 | 
  <aaron> | 
  cleared profiling data | 
  [production] | 
            
  | 20:12 | 
  <aaron> | 
  cleared profiling data | 
  [production] | 
            
  | 20:09 | 
  <Ryan_Lane> | 
  upgrading glance, keystone and nova-scheduler on virt0 | 
  [production] | 
            
  | 20:09 | 
  <Ryan_Lane> | 
  upgrading nova services on compute nodes | 
  [production] | 
            
  | 20:07 | 
  <aaron> | 
  synchronized php-1.22wmf4/includes/specials/SpecialActiveusers.php  'df79a829457752d21b04e641fda0041e09d13a9f' | 
  [production] | 
            
  | 20:04 | 
  <Ryan_Lane> | 
  disabling OpenStackManager | 
  [production] | 
            
  | 20:04 | 
  <Ryan_Lane> | 
  stopping all openstack services. it won't be possible to log into wikitech during this process | 
  [production] | 
            
  | 19:44 | 
  <paravoid> | 
  running refreshFileHeaders.php on terbium | 
  [production] | 
            
  | 19:24 | 
  <aaron> | 
  cleared profiling data | 
  [production] | 
            
  | 19:18 | 
  <Ryan_Lane> | 
  adding temporary ubuntu-cloud archive apt changes in a non-puppetized way on pmtpa virt nodes | 
  [production] | 
            
  | 19:17 | 
  <Ryan_Lane> | 
  disabling puppet on pmtpa virt cluster | 
  [production] | 
            
  | 19:09 | 
  <reedy> | 
  synchronized wmf-config/  'touch!' | 
  [production] | 
            
  | 19:08 | 
  <reedy> | 
  synchronized php-1.22wmf4/resources/  'touch!' | 
  [production] | 
            
  | 18:42 | 
  <Ryan_Lane> | 
  cherry-picked change 62100 on virt0 until permanent fix for jquery.chosen minimum width is added | 
  [production] | 
            
  | 18:41 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: commons back to 1.22wmf4 | 
  [production] | 
            
  | 18:40 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: commons back to 1.22wmf3 due to broken UploadWizard | 
  [production] | 
            
  | 18:34 | 
  <^demon> | 
  restarting gerrit | 
  [production] | 
            
  | 18:28 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: aaaand wikisource to 1.22wmf4 | 
  [production] | 
            
  | 18:26 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikinews and wikiquote to 1.22wmf4 | 
  [production] | 
            
  | 18:25 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity and wikibooks to 1.22wmf4 | 
  [production] | 
            
  | 18:21 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage and wiktionary to 1.22wmf4 | 
  [production] | 
            
  | 18:18 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: fishbowl, special, wikimedia and private to 1.22wmf4 | 
  [production] | 
            
  | 18:00 | 
  <maxsem> | 
  synchronized php-1.22wmf3/extensions/MobileFrontend/ | 
  [production] | 
            
  | 17:57 | 
  <RobH> | 
  authdns update, killin dataset1 entries | 
  [production] | 
            
  | 17:56 | 
  <yurik> | 
  synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 17:49 | 
  <Ryan_Lane> | 
  deploying new project filter on virt0 | 
  [production] | 
            
  | 17:43 | 
  <yurik> | 
  synchronized php-1.22wmf4/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 16:57 | 
  <RobH> | 
  authdns update, cleaning out old decom entries | 
  [production] |