| 2009-01-29
      
      § | 
    
  | 22:55 | <mark> | Did s/knams/esams/ on the selective AAAA answer config of ns0/ns1/ns2.wikimedia.org | [production] | 
            
  | 22:48 | <mark> | While messages are held in the queue on williams, use "mailq" to view the queue, and "exim -M <messageid>" to let an individual message through for testing | [production] | 
            
  | 22:44 | <mark> | SpamAssassin training from the OTRS Junk queue not yet setup | [production] | 
            
  | 22:43 | <mark> | '''Note:''' Exim on williams queries for mail addresses from the ''live'' OTRS database, not the test database | [production] | 
            
  | 22:42 | <mark> | Completed OTRS mail setup on williams. wikitech documentation updated in [[OTRS]] and [[Mail]]. OTRS mail is still copied to williams, and then held on the queue. | [production] | 
            
  | 22:00 | <mark> | Added db10 as secondary DB to query for Exim on mchenry | [production] | 
            
  | 21:59 | <mark> | Granted SELECT privileges on otrs.system_address to exim@williams on db9/db10 | [production] | 
            
  | 21:58 | <brion> | enabling revision & log suppression for oversighters | [production] | 
            
  | 21:12 | <brion> | live-merging r46429 change to Special:Contributions -- stub marking fix | [production] | 
            
  | 21:01 | <mark> | Copying OTRS mail to williams, where it's automatically held in the queue without extra processing; useful for testing | [production] | 
            
  | 21:01 | <mark> | Installed SpamAssassin on williams for OTRS, copied training data from bart | [production] | 
            
  | 19:18 | <brion> | aborted old enwiki dump so a fresh one can start, since that old history will never finish on the old system | [production] | 
            
  | 19:17 | <brion> | updated data dump scripts | [production] | 
            
  | 17:57 | <brion> | disabled 'mark patrolled' link for views without specific rcid param; but now it's back when we actually ask for it so actual rc/new pages patrol works again http://rafb.net/p/puGHC095.html | [production] | 
            
  | 17:54 | <brion> | poking at patrol link live hack | [production] | 
            
  | 17:40 | <brion> | erzurumi is rebooted and serving out PDFs again. need to implement some resource limits... | [production] | 
            
  | 17:35 | <brion> | rebooting erzurumi via drac | [production] | 
            
  | 17:32 | <brion> | i hate the drac shell | [production] | 
            
  | 17:24 | <brion> | erzurumi appears to have been victim to a massive memory leak. seeing if we can reboot it | [production] | 
            
  | 17:17 | <brion> | poking at mw-serve on erzurumi; not responding | [production] | 
            
  | 16:15 | <domas> | livehacked out 'patrol' link on article views %) | [production] | 
            
  | 04:02 | <Tim> | added DNS entry for OTRS test | [production] | 
            
  | 01:31 | <Tim> | fixed srv76 and the wikimedia-task-appserver package | [production] | 
            
  | 01:31 | <brion-busy> | syncing r46513 -- fix for categoryfinder, update to fix for Collection | [production] | 
            
  | 01:14 | <brion-busy> | updating Collection ext -- compat issue with changed category | [production] | 
            
  | 00:56 | <brion-busy> | stopped apache on srv76 for the moment | [production] | 
            
  | 00:55 | <brion-busy> | srv76 doesn't have upload5 mounted | [production] | 
            
  | 00:41 | <brion> | live-hacking out a broken check in getDupeWarning() | [production] | 
            
  | 00:22 | <Tim> | synced nagios config | [production] | 
            
  
    | 2009-01-28
      
      § | 
    
  | 23:40 | <mark> | s/knams/esams/ in DNS geobackend files | [production] | 
            
  | 23:25 | <mark> | Deployed fix in /lib/lsb/init-functions on sanger, mchenry, williams and lily which caused (amongst others) Exim reloads (-HUP) to be turned into a kill -TERM (Debian bug #434756) | [production] | 
            
  | 23:16 | <mark> | Set up basic mail system for OTRS on williams. Still incomplete and needs fine tuning and testing, spam checking is not yet implemented amongst other things. | [production] | 
            
  | 22:30 | <mark> | Restarted Exim on sanger, disappeared mysteriously | [production] | 
            
  | 21:50 | <mark> | Raised Dovecot max login process count from 128 to 1024 | [production] | 
            
  | 21:04 | <brion> | merging reupload fixed: r46479, r46483, r46487 | [production] | 
            
  | 20:49 | <mark> | Base OS install finished on williams.wikimedia.org | [production] | 
            
  | 20:02 | <brion> | merging r46472 (FlaggedRevs autopromote fix), r46464-46476 (feed RTL style fix, re-upload disabled field fix) | [production] | 
            
  | 18:05 | <RobH> | setup mail relay for wikimedia.cz for Danny and Co  ;] | [production] | 
            
  | 08:43 | <domas> | s3 replication switched from db1-bin.325:437169827 to db11-bin.026\t:79 | [production] | 
            
  | 08:35 | <domas> | s2 rep switched from ixia-bin.150:119337662 to db13-bin.004:79 | [production] | 
            
  | 06:15 | <Tim> | creating backup of db10 on storage2 | [production] | 
            
  | 04:29 | <brion> | svn up'ing and scapping to r46424 consistently | [production] | 
            
  | 04:22 | <brion> | updating FlaggedRevs to r46422 | [production] | 
            
  | 04:17 | <brion> | merging r46419, r46421 -- search display fixlets | [production] | 
            
  | 03:51 | <brion> | attempting scap again; tweaking DataCenter.ui.php since the scap syntax checks are whinging about the abstract static method o_O | [production] | 
            
  | 03:40 | <brion> | scapping to r46413 | [production] | 
            
  | 01:35 | <brion> | svn up'ing to r46413 on test... | [production] |