| 
      
        2013-09-24
      
      §
     | 
  
    
  | 08:12 | 
  <hashar> | 
  8:12am INFO: Jenkins is fully up and running | 
  [production] | 
            
  | 08:06 | 
  <springle> | 
  labstore4 locked up, power cycled | 
  [production] | 
            
  | 07:43 | 
  <hashar> | 
  upgrading Jenkins on gallium from 1.509.2 to 1.509.3 | 
  [production] | 
            
  | 06:36 | 
  <springle> | 
  upgrading db1002 to precise and mariadb | 
  [production] | 
            
  | 06:13 | 
  <^demon|zzz> | 
  ES: enwikisource & cawiki done indexing. Really need to revisit batch indexing, way too slow. | 
  [production] | 
            
  | 03:42 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1002 for upgrade, db1036 take up slack' | 
  [production] | 
            
  | 03:17 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php | 
  [production] | 
            
  | 02:40 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Tue Sep 24 02:40:38 UTC 2013 | 
  [production] | 
            
  | 02:21 | 
  <LocalisationUpdate> | 
  completed (1.22wmf17) at Tue Sep 24 02:21:27 UTC 2013 | 
  [production] | 
            
  | 02:15 | 
  <LocalisationUpdate> | 
  completed (1.22wmf18) at Tue Sep 24 02:15:01 UTC 2013 | 
  [production] | 
            
  
    | 
      
        2013-09-23
      
      §
     | 
  
    
  | 23:36 | 
  <RoanKattouw> | 
  mw1072 is unhappy, sync-file throws warnings about read-only filesystem | 
  [production] | 
            
  | 23:35 | 
  <catrope> | 
  synchronized php-1.22wmf18/extensions/VisualEditor  'VisualEditor cherry-picks' | 
  [production] | 
            
  | 23:35 | 
  <catrope> | 
  synchronized php-1.22wmf17/extensions/VisualEditor  'VisualEditor cherry-picks' | 
  [production] | 
            
  | 23:20 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Set VisualEditor to opt-in on enwiki' | 
  [production] | 
            
  | 20:57 | 
  <demon> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 20:48 | 
  <reedy> | 
  synchronized wmf-config/  'touch' | 
  [production] | 
            
  | 20:46 | 
  <reedy> | 
  synchronized php-1.22wmf18/extensions/UploadWizard | 
  [production] | 
            
  | 20:09 | 
  <Reedy> | 
  mw1072 has a r/o filesystem | 
  [production] | 
            
  | 20:05 | 
  <demon> | 
  synchronized wmf-config/InitialiseSettings.php  'Cirrus as primary for itwikt, secondary on cawiki and enwikisource' | 
  [production] | 
            
  | 19:46 | 
  <reedy> | 
  synchronized wmf-config  'touch' | 
  [production] | 
            
  | 19:36 | 
  <reedy> | 
  synchronized database lists files: | 
  [production] | 
            
  | 19:35 | 
  <reedy> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 18:50 | 
  <Ryan_Lane> | 
  enabling cirrussearch for wikitech | 
  [production] | 
            
  | 18:43 | 
  <Reedy> | 
  Created sites and site_identifier tables on commonswiki | 
  [production] | 
            
  | 18:41 | 
  <Ryan_Lane> | 
  upgrading wikitech-static to 1.22wmf18 | 
  [production] | 
            
  | 18:41 | 
  <Ryan_Lane> | 
  upgraded wikitech to 1.22wmf18 | 
  [production] | 
            
  
    | 
      
        2013-09-21
      
      §
     | 
  
    
  | 18:42 | 
  <hashar> | 
  Jenkins: upgrading pep8 from 1.4.5 to 1.4.6 on gallium and lanthanum | 
  [production] | 
            
  | 03:21 | 
  <Reedy> | 
  Scalers fixed | 
  [production] | 
            
  | 03:16 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 03:07 | 
  <hashar> | 
  imagescalers in eqiad shows a drop of CPU/network at around 1:40am UTC.   Thumbnails are no more rendered :-( | 
  [production] | 
            
  | 02:07 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Sat Sep 21 02:07:36 UTC 2013 | 
  [production] | 
            
  | 02:02 | 
  <LocalisationUpdate> | 
  completed (1.22wmf18) at Sat Sep 21 02:02:26 UTC 2013 | 
  [production] | 
            
  | 02:01 | 
  <LocalisationUpdate> | 
  completed (1.22wmf17) at Sat Sep 21 02:01:44 UTC 2013 | 
  [production] | 
            
  | 01:38 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:53 | 
  <reedy> | 
  synchronized wmf-config/throttle.php | 
  [production] | 
            
  | 00:45 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:43 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:41 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:40 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:38 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 00:23 | 
  <reedy> | 
  synchronized w | 
  [production] | 
            
  | 00:13 | 
  <reedy> | 
  synchronized w | 
  [production] | 
            
  | 00:09 | 
  <reedy> | 
  synchronized w | 
  [production] |