| 2009-03-24
      
      § | 
    
  | 23:57 | <Tim> | changing master for rc1 to ms3. Omitting srv183, which will be removed from the group. | [production] | 
            
  | 23:46 | <azafred_> | udpated motd on srv32 to reflect its puppeteer status. | [production] | 
            
  | 23:35 | <domas> | experimented with PG vs MySQL5.0 performance on db28 :) | [production] | 
            
  | 23:34 | <robh> | synchronized php-1.5/InitialiseSettings.php  'Ack, added to foundationwiki, not fishbowl, reverted, and added to fishbowl.' | [production] | 
            
  | 23:07 | <Rob> | lowered the memory limit on usability project server | [production] | 
            
  | 22:52 | <robh> | synchronized php-1.5/InitialiseSettings.php  'Adding an inactive group to foundationwiki' | [production] | 
            
  | 22:43 | <brion> | usability.wikimedia.org timing out | [production] | 
            
  | 22:23 | <azafred_> | fixed spamassassin rules compilation on mchenry to speed up the process | [production] | 
            
  | 22:22 | <azafred_> | Updated spamassassin rules to include more spam definitions on mchenry. | [production] | 
            
  | 21:36 | <brion> | updating usability.wikimedia.org to current, installing AntiSpoof, AbuseFilter to help clean up vandalism problems | [production] | 
            
  | 18:59 | <azafred_> | bounced apache on srv201 | [production] | 
            
  | 18:58 | <azafred_> | bounced apache on srv188 | [production] | 
            
  | 18:30 | <Rob> | pushing apache changes for wikizdroje.cz for cs.wikisource.org | [production] | 
            
  | 17:40 | <azafred_> | restarted apache on srv190 | [production] | 
            
  | 15:30 | <robh> | synchronized php-1.5/InitialiseSettings.php  'Bug 18023 Enable Collection extension on svwiki' | [production] | 
            
  | 15:22 | <robh> | synchronized php-1.5/InitialiseSettings.php  '//For bug 18061 Remove obsolete settings from cluster config files' | [production] | 
            
  | 10:45 | <midom> | synchronized php-1.5/includes/specials/SpecialRecentchanges.php  'RC cost became too high to support 5000 limit, decreased to 500' | [production] | 
            
  | 06:56 | <Tim> | stopped mysql on srv171 and srv183 for copy to ms2 and ms3. Depooled. | [production] | 
            
  | 06:55 | <tstarling> | synchronized php-1.5/db.php | [production] | 
            
  | 06:53 | <Tim> | installed ganglia on ms2 and ms3, put them in the mysql cluster | [production] | 
            
  | 04:31 | <andrew> | synchronized php-1.5/InitialiseSettings.php  'I broke plwiki' | [production] | 
            
  | 04:27 | <andrew> | synchronized php-1.5/InitialiseSettings.php  'Bugs 18073, 18094, 18102, AbuseFilter for commons, plwiki, svwiki' | [production] | 
            
  | 04:22 | <andrew> | synchronized php-1.5/CommonSettings.php  'Custom AbuseFilter settings for plwiki (bug 18073)' | [production] | 
            
  | 01:41 | <mark> | Installed Ubuntu on ms2; ms3 and ms2 are now ready for ES usage | [production] | 
            
  
    | 2009-03-23
      
      § | 
    
  | 23:32 | <tstarling> | synchronized php-1.5/InitialiseSettings.php  'rate limit exemption for usability testing' | [production] | 
            
  | 22:56 | <domas> | db1 will serve fr/ja soonish | [production] | 
            
  | 22:56 | <midom> | synchronized php-1.5/db.php  'removing db1' | [production] | 
            
  | 18:58 | <Rob> | upgraded spam plugin on wikimedia blog (shows old stuff in dashboard due to caching, its updated now) | [production] | 
            
  | 18:23 | <aZaFred> | Setup access on LDAP and NIS for fvassard. | [production] | 
            
  | 13:36 | <midom> | synchronized php-1.5/db.php  'rename s2a into s2dewiki, add s2commons with single primary server ixia, enable ixia with commons-only dataset, *poof*' | [production] | 
            
  | 00:34 | <brion-weekend> | customized style a bit on [[techblog.wikimedia.org]] | [production] | 
            
  
    | 2009-03-22
      
      § | 
    
  | 23:14 | <Tim> | killed long-running tidy instance on srv108 | [production] | 
            
  | 22:10 | <Tim> | restarted memcached on srv82 | [production] | 
            
  | 12:15 | <domas> | dumping commonswiki from db30 with server still pooled in and 4 dumper threads | [production] | 
            
  | 10:38 | <domas> | hey, I found remote code execution vulnerability, it seems! :) | [production] | 
            
  | 10:37 | <andrew> | synchronized php-1.5/extensions/AbuseFilter/AbuseFilter.parser.php  '--message=Arbitrary execution vulnerability in AbuseFilter, exploitable only by admins' | [production] | 
            
  | 06:00 | <tstarling> | synchronized php-1.5/db.php  'depooled ixia, is full' | [production] | 
            
  | 05:54 | <Tim> | db5 was running out of disk space due to excessive relay logs. Ran RESET SLAVE. | [production] | 
            
  | 03:02 | <andrew> | synchronized php-1.5/extensions/AbuseFilter/Views/AbuseFilterViewExamine.php  '18096 Special:AbuseFilter/examine doesn't list new account creation log entries' | [production] | 
            
  | 02:47 | <andrew> | synchronized php-1.5/extensions/AbuseFilter/AbuseFilter.class.php  'Fixed bug in batch testing interface' | [production] | 
            
  | 02:41 | <andrew> | synchronized php-1.5/extensions/AbuseFilter/AbuseFilter.parser.php  'Optimisation of rmdoubles, causes 20-fold performance improvement on large pages' | [production] | 
            
  | 02:23 | <andrew> | synchronized php-1.5/extensions/AbuseFilter/Views/AbuseFilterViewDiff.php  'Prevent leaking of private filters through diff interface' | [production] |