| 2011-01-24
      
      § | 
    
  | 23:53 | <Ryan_Lane> | upgrading nova-* packages on nova-*.tesla | [production] | 
            
  | 23:22 | <Ryan_Lane> | rebooting nova-compute1/2 | [production] | 
            
  | 21:20 | <Ryan_Lane> | rebooting nova-controller.tesla | [production] | 
            
  | 18:56 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'Kill another Nogomatch remnant, commented-out experiment from 2005' | [production] | 
            
  | 18:49 | <catrope> | synchronized php-1.5/wmf-config/CommonSettings.php  'Remove Nogomatch, experimental since 2005 and doesn't seem to log anywhere' | [production] | 
            
  | 18:04 | <RobH> | sq86 still above normal ms4 connection thresholds, leaving it at increased rate for now | [production] | 
            
  | 17:24 | <mark> | Applied ipv4 route-map to ipv6 AS 6908 BGP session on br1-knams, so IPv6 routes via 6908 2828 are preferred, and IPv6 connectivity between pmtpa and esams is working again | [production] | 
            
  | 17:11 | <RobH> | sq86 is back online with lucid, set ms4 maxcon to 800 while it catches up | [production] | 
            
  | 16:59 | <mark> | Rebooting spence | [production] | 
            
  | 16:27 | <mark> | AMS-IX migration complete, all BGP sessions back up again | [production] | 
            
  | 16:17 | <mark> | Shutting down all AMS-IX sessions for SFP+ ER test migration | [production] | 
            
  | 16:01 | <RobH> | sq86 coming down for upgrade to lucid | [production] | 
            
  | 15:27 | <mark> | Shutdown project1 for decommissioning | [production] | 
            
  | 13:33 | <demon> | synchronized php-1.5/wmf-config/CommonSettings.php  'Reverting codereview-proxy removal, did not work' | [production] | 
            
  | 13:31 | <demon> | synchronized php-1.5/wmf-config/CommonSettings.php  'Removing codereview-proxy step from CR' | [production] | 
            
  | 13:05 | <mark> | Purged payments1/payments2 resources from the exported Puppet database on db9 | [production] | 
            
  | 12:57 | <mark> | Restarted ntpd on srv236 | [production] | 
            
  | 12:55 | <mark> | Added puppet classes ntp::client and ganglia to snapshot1-3 | [production] | 
            
  | 12:50 | <mark> | Unstuck APT on knsq29, and fixed puppet | [production] | 
            
  | 12:47 | <mark> | Fixed puppet on Kaulen | [production] | 
            
  | 12:46 | <mark> | Removed APT pin -10 for Wikimedia repository on Kaulen - this has been fixed | [production] | 
            
  | 12:44 | <mark> | Unstuck APT on knsq30, and fixed puppet | [production] | 
            
  | 12:38 | <mark> | Finished upgrade of Kaulen | [production] | 
            
  | 12:28 | <mark> | Unstuck APT on knsq8, and fixed puppet | [production] | 
            
  | 12:12 | <mark> | Starting distribution upgrade on Kaulen | [production] | 
            
  | 12:03 | <mark> | Patched Bugzilla on Kaulen | [production] | 
            
  
    | 2011-01-23
      
      § | 
    
  | 15:19 | <jeluf> | synchronized php-1.5/wmf-config/CommonSettings.php  '26886 - Move toggle for DoubleWiki to InitialiseSettings.php' | [production] | 
            
  | 15:18 | <jeluf> | synchronized php-1.5/wmf-config/InitialiseSettings.php  '26886 - Move toggle for DoubleWiki to InitialiseSettings.php' | [production] | 
            
  | 14:41 | <jeluf> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'fix logo of ruewiki' | [production] | 
            
  | 14:34 | <JeLuF> | created Rusyn Wikipedia, ruewiki | [production] | 
            
  | 14:14 | <jeluf> | ran sync-common-all  '25924 - Create Wikipedia in Rusyn' | [production] | 
            
  | 13:51 | <JeLuF> | addwiki.php broken. SQL error: "1283: Column 'si_title' cannot be part of FULLTEXT index (10.0.6.49)" | [production] | 
            
  | 11:58 | <hashar:> | I did add eowikisource yesterday. Will write a report to wikitech-l asap | [production] | 
            
  | 11:48 | <hashar> | synchronized php-1.5/wmf-config/InitialiseSettings.php  '18479 - Set $wgUseDynamicDates = false for the English Wikipedia' | [production] | 
            
  | 01:28 | <jeluf> | synchronized php-1.5/wmf-config/InitialiseSettings.php  '26323 - Requestin ReaderFeedback be enabled on ru.wikinews' | [production] | 
            
  
    | 2011-01-22
      
      § | 
    
  | 21:39 | <RobH> | set sq83, sq84, and sq85 ms4 maxconn back to 100, all were well below and no longer needed increased max. | [production] | 
            
  | 19:42 | <apergos> | removing eowikisource, which was added to this file today but apparently doesn't exist; this breaks SUL-related things | [production] | 
            
  | 19:42 | <ariel> | synchronized all.dblist | [production] | 
            
  | 18:29 | <hashar> | synchronized php-1.5/wmf-config/wgConf.php  'indentation' | [production] | 
            
  | 17:14 | <hashar:> |  | [production] | 
            
  | 17:13 | <hashar:> | testing script sorry | [production] | 
            
  | 16:59 | <26853> | - Local upload disabled at Swedish Wikisource | [production] | 
            
  | 16:59 | <hashar> | synchronized php-1.5/wmf-config/InitialiseSettings.php | [production] | 
            
  | 14:19 | <hashar> | ran rsync manually on srv287 after receiving this message from scap "rsync error: some files could not be transferred (code 23) at main.c(1385) [generator=2.6.9]" | [production] | 
            
  | 14:10 | <hashar> | ran sync-common-all  'Bug 16878 - Disable Special:CrossNamespaceLinks' | [production] | 
            
  | 12:07 | <hashar> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'Bug 11776 - Showing also articles in the CategoryTree of categories in he-wiki' | [production] |