| 2010-07-22
      
      § | 
    
  | 15:05 | <RoanKattouw> | Defunct Apache process running on srv86, Apache won't start. Need root to kill zombie | [production] | 
            
  | 15:04 | <RoanKattouw> | Started Apache on srv270, srv163, had died for some reason | [production] | 
            
  | 15:04 | <RoanKattouw> | Deployed r69728, r69729 (UsabilityInitiative, Vector updates) about 30 minutes ago | [production] | 
            
  | 15:03 | <RoanKattouw> | <RoanKattouw>\t!log Deploying r69728, r69729 (UsabilityInitiative, Vector updates) to test.wikipedia.org | [production] | 
            
  | 15:03 | <RoanKattouw> | <mark>\t!log Upgraded Locke to Ubuntu 10.04 Lucid | [production] | 
            
  | 15:03 | <RoanKattouw> | <logmsgbot>\t!log kate synchronized php-1.5/wmf-config/db.php 'removed ixia to dump s4 for TS' | [production] | 
            
  | 15:03 | <RoanKattouw> | <logmsgbot>\t!log kate synchronized php-1.5/wmf-config/db.php 'removed db7 to dump s6 for TS' | [production] | 
            
  | 15:03 | <RoanKattouw> | <logmsgbot>\t!log kate synchronized php-1.5/wmf-config/db.php 'removing db27 to dump s3 for TS' | [production] | 
            
  | 15:02 | <RoanKattouw> | Started morebots as catrope. werdnum has a defunt instance running that I can't kill | [production] | 
            
  
    | 2010-07-21
      
      § | 
    
  | 20:02 | <catrope> | synchronized php-1.5/extensions/CodeReview/ui/CodeRevisionListView.php  'r69705' | [production] | 
            
  | 19:44 | <Rob> | all 5 new misc servers have mgmt working, will allocate network port in a bit and get them loaded up | [production] | 
            
  | 19:43 | <mark> | Setup logging for [[Special:Book]] on locke | [production] | 
            
  | 19:42 | <Rob> | all dns servers back online and happy | [production] | 
            
  | 19:38 | <Rob> | grosley back online providing services | [production] | 
            
  | 19:30 | <Rob> | grosley was down due to my dns issue, rebooting it, sorry about that. | [production] | 
            
  | 19:29 | <Rob> | restarted pdns on linne | [production] | 
            
  | 19:25 | <Rob> | fixed letter reversal in dns, repushed | [production] | 
            
  | 19:13 | <Rob> | linne pdns restarted | [production] | 
            
  | 19:06 | <Rob> | updating dns for 5 new misc servers mgmt | [production] | 
            
  | 16:35 | <Rob> | lots more time wasted diagnosing evident mainboard failures on srv284, hopefully replacement will soon be inroute | [production] | 
            
  | 16:10 | <mark> | Done basic setup of asw-b-sdtpa, added to RANCID and torrus | [production] | 
            
  | 14:27 | <Rob> | ms1 is back, passing it off to someone who doesnt hate it | [production] | 
            
  | 14:06 | <Rob> | working on ms1, no touchy | [production] | 
            
  | 09:56 | <catrope> | synchronized php-1.5/includes/api/ApiLogin.php  'r69661' | [production] | 
            
  | 02:23 | <Tim> | increasing nagios retry count for NTP from 8 to 15 | [production] | 
            
  
    | 2010-07-20
      
      § | 
    
  | 15:55 | <Rob> | pushed blog and techblog updates on existing plugins, core wordpress, but not themes (because I dont feel like rehacking our css) | [production] | 
            
  | 15:41 | <robh> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'Bug 24374 - Create new usergroups at commons' | [production] | 
            
  | 15:35 | <robh> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'Bug 24364 - Install Extension:Collection for PDF export on foundation wiki' | [production] | 
            
  | 15:16 | <Rob> | synced for bug 24449 disable file talk pages on cs wikis (since they all have upload disabled) | [production] | 
            
  | 15:15 | <robh> | synchronized php-1.5/wmf-config/InitialiseSettings.php | [production] | 
            
  | 14:34 | <robh> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'noboard_chapterswikimedia logo' | [production] | 
            
  | 14:16 | <catrope> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'Change dbname noboardwiki -> noboard_chapterswikimedia' | [production] | 
            
  | 14:12 | <robh> | ran sync-common-all | [production] | 
            
  | 13:54 | <andrew> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'communityapplications is too long for user_groups table' | [production] | 
            
  | 13:48 | <andrew> | synchronizing Wikimedia installation... Revision: 69504 | [production] | 
            
  | 13:48 | <Andrew> | scapping to deploy CommunityApplications extension | [production] | 
            
  | 13:47 | <andrew> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'New group for viewing community applications' | [production] | 
            
  | 13:42 | <andrew> | synchronized php-1.5/wmf-config/InitialiseSettings.php  'New group for viewing community applications' | [production] | 
            
  | 13:32 | <robh> | ran sync-common-all | [production] | 
            
  | 12:21 | <andrew> | synchronized php-1.5/extensions/CommunityHiring/SpecialCommunityHiring.php  'r69606' | [production] | 
            
  | 12:20 | <andrew> | synchronized php-1.5/extensions/CommunityHiring/CommunityHiring.php | [production] | 
            
  | 12:20 | <andrew> | synchronized php-1.5/wmf-config/CommonSettings.php  'Configuration changes for r69606' | [production] | 
            
  | 11:53 | <Andrew> | Adding CommunityHiring tables to officewiki database | [production] |