| 
      
        2011-10-04
      
      §
     | 
  
    
  | 16:43 | 
  <notpeter> | 
  stopping all services (memcache, job-runner,apache, and puppet) on srv226-247 | 
  [production] | 
            
  | 16:12 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Add index NS to fawikisource' | 
  [production] | 
            
  | 16:06 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 1 more memecache instances for lucid upgrades' | 
  [production] | 
            
  | 15:41 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 30721 - add namespace alias on latin wikisource (la.ws)' | 
  [production] | 
            
  | 15:38 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set more mznwiki aliases' | 
  [production] | 
            
  | 15:35 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set portal canonical ns for mznwiki' | 
  [production] | 
            
  | 15:34 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Revert that' | 
  [production] | 
            
  | 15:34 | 
  <robh> | 
  installing os on mw1001-mw1160 | 
  [production] | 
            
  | 15:33 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set portal canonical ns for mznwiki' | 
  [production] | 
            
  | 15:31 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 2 memecache instances for lucid upgrades' | 
  [production] | 
            
  | 15:27 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set mznwiki metanamespaces' | 
  [production] | 
            
  | 15:22 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Remove wgGrammarForms as its in WikimediaMessages now' | 
  [production] | 
            
  | 15:16 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Swap space for _ for ruwiki incubator NS' | 
  [production] | 
            
  | 15:12 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 30752 - Update namespaces for Mazandarani Wikipedia (mznwiki)' | 
  [production] | 
            
  | 15:06 | 
  <robh> | 
  sq47 offline for system tests | 
  [production] | 
            
  | 15:00 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 2 memecache instances for lucid upgrades' | 
  [production] | 
            
  | 14:57 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Make ruwiki incubator ns non indexed' | 
  [production] | 
            
  | 14:44 | 
  <robh> | 
  updating dns with row B eqiad mw servers | 
  [production] | 
            
  | 14:34 | 
  <Reedy> | 
  run namespaceDupes on azwikiquote | 
  [production] | 
            
  | 14:32 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 31245 - Change project namespace on azwikiquote to Vikisitat' | 
  [production] | 
            
  | 14:31 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 31245 - Change project namespace on azwikiquote to Vikisitat' | 
  [production] | 
            
  | 14:30 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 2 memecache instances for lucid upgrades' | 
  [production] | 
            
  | 14:27 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'set wgMetanamespace for azwikiquote' | 
  [production] | 
            
  | 14:16 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 2 memecache instances for lucid upgrades' | 
  [production] | 
            
  | 14:14 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set azwikiquote sitename to Vikisitat' | 
  [production] | 
            
  | 14:13 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Set azwikiquote sitename to Vikisitat' | 
  [production] | 
            
  | 13:45 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 31299 - Rename namespace and enable $wgExtraGenderNamespaces on pl.wiktionary' | 
  [production] | 
            
  | 13:43 | 
  <py> | 
  synchronized wmf-config/mc.php  'new mc.php to swap 2 memecache instances for lucid upgrades' | 
  [production] | 
            
  | 13:28 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 31142 - Narayam Install request' | 
  [production] | 
            
  | 12:43 | 
  <notpeter> | 
  gracefulling apache on srv155 to load new php ini's | 
  [production] | 
            
  | 02:41 | 
  <tstarling> | 
  synchronized wmf-config/InitialiseSettings.php  're-enabled Collection on eswiki' | 
  [production] | 
            
  | 02:39 | 
  <Tim> | 
  killed mw-qserve on pdf1 and pdf3 and let supervise restart it. Apparently the queue size counters drifted and they thought they were busy when they weren't. | 
  [production] | 
            
  | 02:30 | 
  <Tim> | 
  killed some stuck mw-zip processes on pdf1 and pdf3 | 
  [production] | 
            
  | 02:29 | 
  <LocalisationUpdate> | 
  completed (1.18) at Tue Oct  4 02:31:47 UTC 2011 | 
  [production] | 
            
  | 02:26 | 
  <LocalisationUpdate> | 
  completed (1.17) at Tue Oct  4 02:28:59 UTC 2011 | 
  [production] | 
            
  | 02:24 | 
  <Tim> | 
  killed some stuck imagemagick processes on pdf1, some were running since 2010! | 
  [production] | 
            
  | 02:20 | 
  <Tim> | 
  restarted gmond on pdf2, it was probably screwed up because of the presence of the ganglia-monitor package | 
  [production] | 
            
  | 01:21 | 
  <tstarling> | 
  synchronized wmf-config/InitialiseSettings.php  'disabling collection extension on eswiki due to DoS' | 
  [production] | 
            
  | 01:14 | 
  <tstarling> | 
  synchronized php-1.17/extensions/Collection/Collection.body.php  'patch to send XFF header' | 
  [production] | 
            
  | 01:13 | 
  <tstarling> | 
  synchronized php-1.18/extensions/Collection/Collection.body.php  'patch to send XFF header' | 
  [production] | 
            
  | 01:12 | 
  <mutante> | 
  sq36,sq37,sq38 - upgrade kernel to 2.6.32-34/dist-upgrade,reboot (RT #1612) | 
  [production] | 
            
  | 00:49 | 
  <mutante> | 
  sq33,sq34,sq35 - upgrade kernel to 2.6.32-34/dist-upgrade,reboot (RT #1612) | 
  [production] | 
            
  | 00:39 | 
  <maplebed> | 
  powercycled pdf2 because it wouldn't respond to ssh | 
  [production] |