| 2011-04-26
      
      § | 
    
  | 23:40 | <nimishg> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 23:33 | <tstarling> | synchronized php-1.17/wmf-config/CommonSettings.php | [production] | 
            
  | 23:26 | <root> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 23:15 | <Tim> | disabled CustomUserSignup, was causing fatal error on mediawiki.org due to incorrect path | [production] | 
            
  | 23:15 | <tstarling> | synchronized php-1.17/wmf-config/CommonSettings.php | [production] | 
            
  | 23:13 | <nimishg> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'turning' | [production] | 
            
  | 23:00 | <nimishg> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'turning' | [production] | 
            
  | 22:55 | <nimishg> | synchronized php-1.17/extensions/CustomUserSignup/CustomUserSignup.hooks.php  'r86994' | [production] | 
            
  | 22:49 | <notpeter> | stopping nagios for a wee sec and then restarting. | [production] | 
            
  | 22:09 | <nimishg> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 22:08 | <nimish_g> | nimishg pushing CustomUserSignup code to cluster, running on mediawikiwiki only | [production] | 
            
  | 21:28 | <awjrichards> | synchronized php-1.17/includes/CategoryPage.php  'r86988' | [production] | 
            
  | 20:38 | <pdhanda> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'enabled CustomUserSignup extension for testwiki' | [production] | 
            
  | 20:37 | <pdhanda> | synchronized php-1.17/wmf-config/CommonSettings.php  'enabled CustomUserSignup extension for testwiki' | [production] | 
            
  | 20:32 | <awjr> | disabled wmf_premiums module on civicrm.wikimedia.org - it is currently not being used and potentially causes queue consumption to choke with certain contribution messages | [production] | 
            
  | 19:51 | <catrope> | ran sync-common-all | [production] | 
            
  | 19:50 | <RoanKattouw> | Running sync-common-all to deploy UploadWizard changse | [production] | 
            
  | 17:52 | <pdhanda> | Running maintenance/populateParentId.php on all wikis | [production] | 
            
  | 08:21 | <Andrew> | sync-common-all worked. scap still broken | [production] | 
            
  | 08:21 | <andrew> | ran sync-common-all | [production] | 
            
  | 08:21 | <Andrew> | trying sync-common-all | [production] | 
            
  | 08:19 | <Andrew> | syncs are broken, log littered with XXX: [sudo] password for andrew: | [production] | 
            
  | 08:12 | <Andrew> | re-scapping, typo in extension-list | [production] | 
            
  | 08:12 | <andrew> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 08:11 | <Andrew> | Scapping to enable DisableAccount extension | [production] | 
            
  | 08:11 | <andrew> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 08:02 | <andrew> | synchronizing Wikimedia installation... Revision: 86895: | [production] | 
            
  | 08:02 | <Andrew> | running scap to deploy the code itself | [production] | 
            
  | 08:01 | <Andrew> | deploying DisableAccount extension to checkuserwiki, stewardwiki, arbcom_enwiki since the special page was removed without consulting Philippe | [production] | 
            
  | 02:15 | <robh> | synchronized php-1.17/wmf-config/InitialiseSettings.php  'adding settings for checkuser and steward wikis' | [production] | 
            
  
    | 2011-04-25
      
      § | 
    
  | 23:33 | <Ryan_Lane> | added python-mwclient to lucid repo | [production] | 
            
  | 21:36 | <RobH> | storage2 still offline, wont boot into os, but is remotely accessible | [production] | 
            
  | 21:20 | <RobH> | trying to fix storage2 | [production] | 
            
  | 20:16 | <notpeter> | actually adding everyone on ops to watchmouse service... didn't know this had not already been done. | [production] | 
            
  | 20:02 | <RobH> | updated csw1 to removed labels and move to default vlan ports 11/12, 11/14, 11/19, & 11/21.  old connection ports for dataset2, tridge, ms1, and ms5 | [production] | 
            
  | 19:53 | <RobH> | the datacenter is looking awesome. | [production] | 
            
  | 19:45 | <RobH> | ms1 moved from temp network to permanent home, no downtime, responding fine | [production] | 
            
  | 19:42 | <RobH> | ms5 connection moved, no downtime, responds fine, less than 4 seconds | [production] | 
            
  | 19:40 | <RobH> | updated csw1-sdtpa 15/1,15/2 from vlan 105 to vlan 2, 15/3 and 15/4 from vlan 105 to 101 | [production] | 
            
  | 18:52 | <RobH> | snapshot4 relocated to new home, ready for os install | [production] | 
            
  | 18:42 | <RobH> | db19 and db20 back online (not in services as they have other issues) | [production] | 
            
  | 18:39 | <RobH> | db19 and db20 powering back up | [production] | 
            
  | 18:25 | <RobH> | virt4 experienced an accidental reboot when rebalancing power in the rack, my fault, not the hardware | [production] |