| 
      
        2010-01-04
      
      §
     | 
  
    
  | 19:06 | 
  <RoanKattouw> | 
  Running rebuildGlobalimagelinks.php on Commons | 
  [production] | 
            
  | 19:03 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/CommonSettings.php  'Re-enabling GlobalUsage' | 
  [production] | 
            
  | 18:57 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/GlobalUsage.i18n.php  'r60611' | 
  [production] | 
            
  | 18:56 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/SpecialGlobalUsage.php  'r60611' | 
  [production] | 
            
  | 18:56 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/GlobalUsage.php  'r60611' | 
  [production] | 
            
  | 18:56 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/GlobalUsageHooks.php  'r60611' | 
  [production] | 
            
  | 18:56 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/GlobalUsage_body.php  'r60611' | 
  [production] | 
            
  | 18:56 | 
  <catrope> | 
  synchronized php-1.5/extensions/GlobalUsage/ApiQueryGlobalUsage.php  'r60611' | 
  [production] | 
            
  | 18:55 | 
  <RoanKattouw> | 
  Deploying r60611 (GlobalUsage update) with individual sync-file's | 
  [production] | 
            
  | 18:49 | 
  <RoanKattouw> | 
  Truncating globalimagelinks table on commonswiki | 
  [production] | 
            
  | 18:48 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/CommonSettings.php  'Temp disable GlobalUsage' | 
  [production] | 
            
  | 18:46 | 
  <RoanKattouw> | 
  Disabling GlobalUsage temporarily for software update | 
  [production] | 
            
  | 18:41 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/ExtensionMessages.php  'Enabling WikimediaLicenseTexts on Commons' | 
  [production] | 
            
  | 18:40 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Enabling WikimediaLicenseTexts on Commons' | 
  [production] | 
            
  | 18:31 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/InitialiseSettings.php  'Enabling WikimediaLicenseTexts on testwiki' | 
  [production] | 
            
  | 18:31 | 
  <catrope> | 
  synchronized php-1.5/wmf-config/CommonSettings.php  'Enabling WikimediaLicenseTexts on testwiki' | 
  [production] | 
            
  | 18:24 | 
  <catrope> | 
  synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.i18n.php  'r60608' | 
  [production] | 
            
  | 18:24 | 
  <catrope> | 
  synchronized php-1.5/extensions/WikimediaMessages/WikimediaMessages.i18n.php  'r60608' | 
  [production] | 
            
  | 18:24 | 
  <catrope> | 
  synchronized php-1.5/extensions/WikimediaMessages/WikimediaMessages.php  'r60608' | 
  [production] | 
            
  | 18:24 | 
  <catrope> | 
  synchronized php-1.5/extensions/WikimediaMessages/WikimediaLicenseTexts.php  'r60608' | 
  [production] | 
            
  | 18:24 | 
  <catrope> | 
  synchronized php-1.5/extensions/WikimediaMessages/WikimediaGrammarForms.php  'r60608' | 
  [production] | 
            
  | 18:23 | 
  <RoanKattouw> | 
  Deploying r60608 (WikimediaMessages update) using sync-file | 
  [production] | 
            
  | 17:47 | 
  <Rob> | 
  search13-search20 racked and ready for install | 
  [production] | 
            
  | 17:17 | 
  <Rob> | 
  updating dns for new search servers | 
  [production] | 
            
  | 14:57 | 
  <mark> | 
  synchronized php-1.5/wmf-config/mc.php  'Replace downed memcached box srv84' | 
  [production] | 
            
  | 14:46 | 
  <Rob> | 
  moved power for asw-b3-pmtpa, srv86 and srv87 may flap. | 
  [production] | 
            
  | 14:43 | 
  <mark> | 
  synchronized php-1.5/wmf-config/mc.php  'Replace downed memcached boxes srv120, srv121' | 
  [production] | 
            
  | 14:31 | 
  <Rob> | 
  decommissioned srv120, srv121 to make room for new search servers. | 
  [production] | 
            
  | 14:29 | 
  <Rob> | 
  pulling srv34 from rack to decommission, need the space for new search servers. | 
  [production] | 
            
  | 14:09 | 
  <mark> | 
  synchronized php-1.5/wmf-config/mc.php  'Replace memcached on just decommissioned host srv82' | 
  [production] | 
            
  | 13:57 | 
  <Rob> | 
  srv82, srv83, srv84 decommissioned to make room for new search servers in rack | 
  [production] | 
            
  | 12:56 | 
  <Tim> | 
  started squid-frontend on knsq8, knsq10, knsq11, knsq13, knsq14, knsq15, all crashed at roughly the same time as knsq9 | 
  [production] | 
            
  | 12:52 | 
  <Tim> | 
  started squid-frontend on knsq9, died at ~17:30 on the 3rd. Syslog shows many crashes, followed by "out of socket memory" a couple of hundred times, then silence | 
  [production] | 
            
  
    | 
      
        2009-12-30
      
      §
     | 
  
    
  | 23:37 | 
  <tfinc> | 
  synchronized php-1.5/extensions/ContributionReporting/FundraiserStatistics_body.php  | 
  [production] | 
            
  | 23:35 | 
  <tfinc> | 
  synchronized php-1.5/extensions/ContributionReporting/ContributionReporting.i18n.php  | 
  [production] | 
            
  | 12:51 | 
  <mark> | 
  Set /proc/sys/vm/min_free_kbytes to 65535 on brewster and streber, to see if it helps with the swapper page allocation failure bug | 
  [production] | 
            
  | 07:57 | 
  <Tim> | 
  fixed private+secure file access, URLs were broken for months at least | 
  [production] | 
            
  | 07:50 | 
  <tstarling> | 
  synchronized php-1.5/wmf-config/secure.php  | 
  [production] | 
            
  | 07:48 | 
  <tstarling> | 
  synchronized php-1.5/wmf-config/secure.php  'possible resolution for boardwiki problem' | 
  [production] | 
            
  | 07:45 | 
  <tstarling> | 
  synchronized php-1.5/wmf-config/secure.php  'debugging hack' | 
  [production] | 
            
  | 07:34 | 
  <Tim> | 
  created an account for myself on boardwiki to debug file upload issue | 
  [production] |