| 
      
        2011-08-24
      
      §
     | 
  
    
  | 19:32 | 
  <catrope> | 
  synchronized wmf-config/CommonSettings.php  | 
  [production] | 
            
  | 19:24 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Re-enable WikimediaIncubator on incubatorwiki' | 
  [production] | 
            
  | 19:07 | 
  <robh> | 
  sq34 unresponsivle to serial console, rebooted | 
  [production] | 
            
  | 19:04 | 
  <robh> | 
  sq34 offline, no rt ticket or admin log entry for a reason to be offline, investigating | 
  [production] | 
            
  | 19:03 | 
  <catrope> | 
  synchronized php/extensions/WikimediaIncubator/IncubatorTest.php  '[[rev:95416|r95416]]' | 
  [production] | 
            
  | 18:37 | 
  <catrope> | 
  synchronized php/extensions/WikimediaMessages/WikimediaMessages.php  '[[rev:95411|r95411]], right path this time' | 
  [production] | 
            
  | 18:37 | 
  <apergos> | 
  doing testing of some new xml dump code on snapshot4 on root, it's writing locally so don't worry about jumps in local disk usage | 
  [production] | 
            
  | 18:36 | 
  <catrope> | 
  synchronized php/includes/EditPage.php  '[[rev:95411|r95411]]' | 
  [production] | 
            
  | 18:28 | 
  <Ryan_Lane> | 
  powercycling virt3 | 
  [production] | 
            
  | 17:47 | 
  <Ryan_Lane> | 
  disabling access_log on srv193 | 
  [production] | 
            
  | 17:41 | 
  <Ryan_Lane> | 
  temporarily enabled the access log on srv193 | 
  [production] | 
            
  | 17:10 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Tidying up wmgUseAbuseFilter' | 
  [production] | 
            
  | 17:07 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Setting wmgUseAbuseFilter to true for all wikis' | 
  [production] | 
            
  | 17:06 | 
  <Reedy> | 
  About to enable AbuseFilter accross all wikis | 
  [production] | 
            
  | 16:38 | 
  <maplebed> | 
  running a puppet experiment - turning off the puppet client on spence from now until 2pm - nagios operation will remain unaffected | 
  [production] | 
            
  | 16:24 | 
  <maplebed> | 
  added roan's key to root's authorized keys | 
  [production] | 
            
  | 15:58 | 
  <robh> | 
  rebooting emery, appears to be hung in boot, but cannot see due to serial console not retaining a backlog when not connected | 
  [production] | 
            
  | 15:37 | 
  <mark> | 
  Reenabled cr1-sdtpa:xe-0/0/0 | 
  [production] | 
            
  | 14:53 | 
  <mark> | 
  Disabled cr1-sdtpa:xe-0/0/0 due to port errors | 
  [production] | 
            
  | 14:31 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Bug 30538 - Change Cantonese Wikipedia (zh-yue.wikipedia) autoconfirmed threshold' | 
  [production] | 
            
  | 09:38 | 
  <catrope> | 
  synchronized php/extensions/MobileFrontend/MobileFrontend.php  '[[rev:95388|r95388]]' | 
  [production] | 
            
  | 02:19 | 
  <LocalisationUpdate> | 
  completed (1.17) at Wed Aug 24 02:21:20 UTC 2011 | 
  [production] | 
            
  
    | 
      
        2011-08-23
      
      §
     | 
  
    
  | 23:49 | 
  <apergos> | 
  limited downloads on dataset2 to 2 simultaneous connections per ip, except our hosts | 
  [production] | 
            
  | 23:12 | 
  <apergos> | 
  forgot to log earlier, limited bandwidth in lighttpd on dataset2 per download except for our hosts | 
  [production] | 
            
  | 21:48 | 
  <Ryan_Lane1> | 
  moved catrope from mortals to roots | 
  [production] | 
            
  | 21:12 | 
  <notpeter> | 
  upgrading squid and squid-frontend on sq86 | 
  [production] | 
            
  | 20:10 | 
  <notpeter> | 
  upgrading squid and squid-frontend on sq85 | 
  [production] | 
            
  | 19:56 | 
  <demon> | 
  synchronized php/includes/specials/SpecialEmailuser.php  '[[rev:95328|r95328]]' | 
  [production] | 
            
  | 18:22 | 
  <notpeter> | 
  upgrading squid and squid-frontend on sq83 | 
  [production] | 
            
  | 18:03 | 
  <robh> | 
  wiped old binlogs off db9 older than 20 days | 
  [production] | 
            
  | 17:16 | 
  <maplebed> | 
  installed a new /etc/sudoers on db36 to placate nagios | 
  [production] | 
            
  | 16:36 | 
  <apergos> | 
  added webzilla.com hosts to urls denied on dataset2, bulk garbage requests and using a pile of bandwidth | 
  [production] | 
            
  | 16:27 | 
  <robh> | 
  reviewed paniclog on lily and mchenry due to non-zero size.  cleared logs to stop email alerts | 
  [production] | 
            
  | 10:58 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable WikimediaIncubator on testwiki for debugging' | 
  [production] | 
            
  | 10:51 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Disable WikimediaIncubator again' | 
  [production] | 
            
  | 10:45 | 
  <catrope> | 
  synchronized wmf-config/CommonSettings.php  'Comment out $wmincClosedWikis' | 
  [production] | 
            
  | 10:38 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Re-enable WikimediaIncubator extension so I can do some profiling' | 
  [production] | 
            
  | 10:37 | 
  <catrope> | 
  synchronized wmf-config/StartProfiler.php  'Add profiling group for debugging incubatorwiki slowness, triggered by a request parameter' | 
  [production] | 
            
  | 10:30 | 
  <catrope> | 
  synchronized wmf-config/InitialiseSettings.php  'Temporarily disable WikimediaIncubator extension due to slowness on incubatorwiki' | 
  [production] | 
            
  | 09:15 | 
  <catrope> | 
  synchronizing Wikimedia installation... Revision: 95304:  | 
  [production] | 
            
  | 09:15 | 
  <RoanKattouw> | 
  Running scap to undo the accidental deployment of yesterday's failed UploadWizard deployment | 
  [production] | 
            
  | 02:19 | 
  <LocalisationUpdate> | 
  completed (1.17) at Tue Aug 23 02:21:27 UTC 2011 | 
  [production] | 
            
  | 00:28 | 
  <^demon> | 
  ran refresh-dblist and sync-dblist | 
  [production] | 
            
  | 00:21 | 
  <^demon> | 
  fixed refresh-dblist since wmf-config was moved | 
  [production] |