| 2011-08-24
      
      § | 
    
  | 18:28 | <Ryan_Lane> | powercycling virt3 | [production] | 
            
  | 17:47 | <Ryan_Lane> | disabling access_log on srv193 | [production] | 
            
  | 17:41 | <Ryan_Lane> | temporarily enabled the access log on srv193 | [production] | 
            
  | 17:10 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Tidying up wmgUseAbuseFilter' | [production] | 
            
  | 17:07 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Setting wmgUseAbuseFilter to true for all wikis' | [production] | 
            
  | 17:06 | <Reedy> | About to enable AbuseFilter accross all wikis | [production] | 
            
  | 16:38 | <maplebed> | running a puppet experiment - turning off the puppet client on spence from now until 2pm - nagios operation will remain unaffected | [production] | 
            
  | 16:24 | <maplebed> | added roan's key to root's authorized keys | [production] | 
            
  | 15:58 | <robh> | rebooting emery, appears to be hung in boot, but cannot see due to serial console not retaining a backlog when not connected | [production] | 
            
  | 15:37 | <mark> | Reenabled cr1-sdtpa:xe-0/0/0 | [production] | 
            
  | 14:53 | <mark> | Disabled cr1-sdtpa:xe-0/0/0 due to port errors | [production] | 
            
  | 14:31 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Bug 30538 - Change Cantonese Wikipedia (zh-yue.wikipedia) autoconfirmed threshold' | [production] | 
            
  | 09:38 | <catrope> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  '[[rev:95388|r95388]]' | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.17) at Wed Aug 24 02:21:20 UTC 2011 | [production] | 
            
  
    | 2011-08-23
      
      § | 
    
  | 23:49 | <apergos> | limited downloads on dataset2 to 2 simultaneous connections per ip, except our hosts | [production] | 
            
  | 23:12 | <apergos> | forgot to log earlier, limited bandwidth in lighttpd on dataset2 per download except for our hosts | [production] | 
            
  | 21:48 | <Ryan_Lane1> | moved catrope from mortals to roots | [production] | 
            
  | 21:12 | <notpeter> | upgrading squid and squid-frontend on sq86 | [production] | 
            
  | 20:10 | <notpeter> | upgrading squid and squid-frontend on sq85 | [production] | 
            
  | 19:56 | <demon> | synchronized php/includes/specials/SpecialEmailuser.php  '[[rev:95328|r95328]]' | [production] | 
            
  | 18:22 | <notpeter> | upgrading squid and squid-frontend on sq83 | [production] | 
            
  | 18:03 | <robh> | wiped old binlogs off db9 older than 20 days | [production] | 
            
  | 17:16 | <maplebed> | installed a new /etc/sudoers on db36 to placate nagios | [production] | 
            
  | 16:36 | <apergos> | added webzilla.com hosts to urls denied on dataset2, bulk garbage requests and using a pile of bandwidth | [production] | 
            
  | 16:27 | <robh> | reviewed paniclog on lily and mchenry due to non-zero size.  cleared logs to stop email alerts | [production] | 
            
  | 10:58 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Enable WikimediaIncubator on testwiki for debugging' | [production] | 
            
  | 10:51 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Disable WikimediaIncubator again' | [production] | 
            
  | 10:45 | <catrope> | synchronized wmf-config/CommonSettings.php  'Comment out $wmincClosedWikis' | [production] | 
            
  | 10:38 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Re-enable WikimediaIncubator extension so I can do some profiling' | [production] | 
            
  | 10:37 | <catrope> | synchronized wmf-config/StartProfiler.php  'Add profiling group for debugging incubatorwiki slowness, triggered by a request parameter' | [production] | 
            
  | 10:30 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Temporarily disable WikimediaIncubator extension due to slowness on incubatorwiki' | [production] | 
            
  | 09:15 | <catrope> | synchronizing Wikimedia installation... Revision: 95304: | [production] | 
            
  | 09:15 | <RoanKattouw> | Running scap to undo the accidental deployment of yesterday's failed UploadWizard deployment | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.17) at Tue Aug 23 02:21:27 UTC 2011 | [production] | 
            
  | 00:28 | <^demon> | ran refresh-dblist and sync-dblist | [production] | 
            
  | 00:21 | <^demon> | fixed refresh-dblist since wmf-config was moved | [production] | 
            
  
    | 2011-08-22
      
      § | 
    
  | 22:39 | <RoanKattouw> | Added UploadWizard tables to testwiki, for real this time | [production] | 
            
  | 22:32 | <preilly> | pushing fix for disable link | [production] | 
            
  | 22:32 | <preilly> | synchronized php/extensions/MobileFrontend/views/information/disable.html.php  'issue with en always being the target of the form' | [production] | 
            
  | 22:21 | <preilly> | remove content type header for now from XHTML view on Mobile Frontend | [production] | 
            
  | 22:21 | <preilly> | synchronized php/extensions/MobileFrontend/MobileFrontend.php  'remove content type header for now' | [production] | 
            
  | 22:07 | <notpeter> | upgrading squid and squid-frontend on sq55 | [production] | 
            
  | 21:46 | <notpeter> | upgrading squid and squid-frontend on sq52 | [production] | 
            
  | 20:59 | <catrope> | synchronized php/extensions/TitleBlacklist/api/ApiQueryTitleBlacklist.php  '[[rev:95249|r95249]]' | [production] | 
            
  | 20:30 | <catrope> | synchronizing Wikimedia installation... Revision: 95237: | [production] | 
            
  | 20:30 | <RoanKattouw> | Deploy new TitleBlacklist code (trunk version) site-wide | [production] | 
            
  | 20:22 | <jeluf> | synchronized wmf-config/InitialiseSettings.php  'Bug 30507 - Please lock flaggedrevs.labs.wikimedia.org' | [production] | 
            
  | 20:19 | <jeluf> | synchronized closed.dblist | [production] | 
            
  | 20:17 | <notpeter> | restarting torrus. again.... | [production] | 
            
  | 20:13 | <RoanKattouw> | ..or not. The SQL is not in 1.17wmf1 yet, will have to wait a few minutes | [production] |