| 2011-09-14
      
      § | 
    
  | 11:56 | <mark> | Upgrading asw-d-pmtpa to junos 10.4R3.4 | [production] | 
            
  | 11:45 | <mark> | Added asw-d-pmtpa to rancid, torrus, observium | [production] | 
            
  | 11:36 | <mark> | Configured asw-d-pmtpa | [production] | 
            
  | 11:12 | <RoanKattouw> | Started Apache again on srv219 now that it's depooled | [production] | 
            
  | 11:10 | <Tim> | removed srv219 from /home/wikipedia/conf/pybal/pmtpa/rendering on reports that it is giving inappropriate PHP errors | [production] | 
            
  | 10:59 | <RoanKattouw> | Stopped Apache on srv219, was spewing lots of PHP errors. Needs an ops person to depool the box | [production] | 
            
  | 10:51 | <RoanKattouw> | logmsgbot: !log catrope synchronized wmf-config/CommonSettings.php 'Raise account creation throttle for India event per IRC request' | [production] | 
            
  | 10:51 | <RoanKattouw> | Restarted morebots | [production] | 
            
  | 02:30 | <LocalisationUpdate> | completed (1.17) at Wed Sep 14 02:32:57 UTC 2011 | [production] | 
            
  | 02:16 | <root> | synchronized wmf-config/InitialiseSettings.php  'Enabling protocol-relative urls for donatewiki' | [production] | 
            
  | 02:04 | <root> | ran sync-common-all | [production] | 
            
  | 00:34 | <preilly> | synchronized php/extensions/MobileFrontend/views/layout/_footmenu_default.html.php  'remove feedback' | [production] | 
            
  | 00:15 | <preilly> | fix for wml issues | [production] | 
            
  | 00:15 | <preilly> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  'fix for wml issues' | [production] | 
            
  
    | 2011-09-13
      
      § | 
    
  | 23:26 | <notpeter> | removing srv219 from rendering pool for upgrade to lucid | [production] | 
            
  | 23:23 | <notpeter> | putting srv220 back into the rendering pool | [production] | 
            
  | 22:26 | <notpeter> | removing srv220 from the rendering pool for upgrade to lucid | [production] | 
            
  | 22:14 | <notpeter> | putting srv221 back into rendering pool | [production] | 
            
  | 21:35 | <binasher> | srv207 was serving traffic with an old deploy and incorrect db.php. synced, and added back to mediawiki-installation grp | [production] | 
            
  | 21:23 | <binasher> | mysql 4.0.40 is dead! | [production] | 
            
  | 21:22 | <binasher> | S6 master changed to db43, master-pos is db43-bin.000227 144900190 | [production] | 
            
  | 21:21 | <asher> | synchronized wmf-config/db.php  'setting S6 to writeable on new master' | [production] | 
            
  | 21:18 | <asher> | synchronized wmf-config/db.php  'setting S6 ({ru,fr,ja}wiki) to read only, replacing mysql master' | [production] | 
            
  | 19:46 | <notpeter> | removing srv221 from rendering pool for upgrade to lucid | [production] | 
            
  | 19:39 | <maplebed> | wikitech ran out of space on /.  removed old log files.  installed logrotate. | [production] | 
            
  | 18:44 | <asher> | synchronized wmf-config/db.php  'setting S5 (dewiki) to read only, replacing mysql master' | [production] | 
            
  | 18:37 | <binasher> | preparing to replace S5 master - will set to readonly shortly | [production] | 
            
  | 18:32 | <notpeter> | removing srv222 from rendering pool for upgrade to lucid | [production] | 
            
  | 18:20 | <preilly> | fix mismatched div | [production] | 
            
  | 18:20 | <preilly> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  'fix for wml card mismatched div' | [production] | 
            
  | 18:05 | <mark> | Rebooted asw-d-pmtpa to recycle VC member IDs | [production] | 
            
  | 18:04 | <preilly> | wml fixes | [production] | 
            
  | 18:04 | <preilly> | synchronized php/extensions/MobileFrontend/views/layout/application.wml.php  'remove element title' | [production] | 
            
  | 18:03 | <preilly> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  'fix for wml card id attribute' | [production] | 
            
  | 14:30 | <reedy> | synchronized php/languages/messages/MessagesEn.php  '[[rev:96969|r96969]]' | [production] | 
            
  | 09:01 | <mutante> | knsq10 - powercycle, dist-upgrade/kernel,squid clean,reboot | [production] | 
            
  | 08:55 | <mutante> | srv281 - powercycle,start apache | [production] | 
            
  | 02:24 | <LocalisationUpdate> | completed (1.17) at Tue Sep 13 02:27:04 UTC 2011 | [production] | 
            
  | 01:16 | <neilk_> | just deployed a config change (wmf-config [[rev:2266|r2266]]) that should fix bug #30797 | [production] | 
            
  | 01:13 | <neilk> | synchronized wmf-config/CommonSettings.php  'the URL for the UploadStash image scaler should not be protocol-relative -- this is invoked with curl, behind the scenes to fetch a scaled image.' | [production] | 
            
  | 00:48 | <notpeter> | putting srv223 back into rendering pool | [production] | 
            
  
    | 2011-09-12
      
      § | 
    
  | 23:37 | <Ryan_Lane> | add CVE-2011-3192 workaround to noc.wm.o | [production] | 
            
  | 23:35 | <midom> | synchronized wmf-config/db.php  'srv157 down' | [production] | 
            
  | 23:23 | <notpeter> | removing srv223 from rendering pool for upgrade | [production] | 
            
  | 22:35 | <preilly> | synchronized wmf-config/InitialiseSettings.php  'config project icons for mobile wikiquote correction' | [production] | 
            
  | 22:32 | <preilly> | pushing mobile project icon change | [production] | 
            
  | 22:31 | <preilly> | synchronized wmf-config/InitialiseSettings.php  'config project icons for mobile' | [production] | 
            
  | 22:07 | <preilly> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  'fix section title with link' | [production] | 
            
  | 21:50 | <reedy> | synchronized php/extensions/UploadWizard/resources/jquery/jquery.mwCoolCats.js  'Bug 30879 - UploadWizard adds categories without [[Category:]] prefix' | [production] | 
            
  | 21:47 | <reedy> | synchronized wmf-config/CommonSettings.php  'Scrap that' | [production] |