| 2010-10-05
      
      § | 
    
  | 21:31 | <RobH> | db16 and db17 going offline to move | [production] | 
            
  | 21:27 | <tfinc> | synchronized php-1.5/extensions/CentralNotice/CentralNotice.i18n.php  'Picking up fixes for geo' | [production] | 
            
  | 21:08 | <midom> | synchronized php-1.5/wmf-config/db.php | [production] | 
            
  | 21:01 | <RobH> | db11 was already moved, opps, rebooting. | [production] | 
            
  | 20:50 | <tfinc> | synchronized php-1.5/skins/common/images/closewindow.png  'Picking up new close button image' | [production] | 
            
  | 20:41 | <RobH> | db11 and db14 also moving | [production] | 
            
  | 20:41 | <robh> | synchronized php-1.5/wmf-config/db.php  'once more with my actual changes' | [production] | 
            
  | 20:39 | <robh> | synchronized php-1.5/wmf-config/db.php  'if this doesnt work its not my fault' | [production] | 
            
  | 20:34 | <RobH> | moving db13 & db14, they are shutting down for a short duration | [production] | 
            
  | 18:17 | <RobH> | db11 shutting down | [production] | 
            
  | 18:05 | <RobH> | storage1 back online | [production] | 
            
  | 17:35 | <mark> | Setup ports 3/35 to 3/44 for db11 to db20 respectively | [production] | 
            
  | 17:31 | <domas> | s3 switched to db27-bin.001:79 | [production] | 
            
  | 17:31 | <midom> | synchronized php-1.5/wmf-config/db.php | [production] | 
            
  | 17:31 | <midom> | synchronized php-1.5/wmf-config/db.php | [production] | 
            
  | 17:28 | <RobH> | moved dataset1 network connection, all good | [production] | 
            
  | 16:32 | <RobH> | dataset on the brain, storage1/2 | [production] | 
            
  | 16:32 | <RobH> | dataset1 shutting down for relocation into b1-sdtpa, dataset2 already offline, moving as well | [production] | 
            
  | 16:15 | <catrope> | synchronized php-1.5/wmf-config/checkers.php  'Remove no-UA exemption for yongle' | [production] | 
            
  | 16:14 | <mark> | Setup csw1-sdtpa:11/2 for amaranth | [production] | 
            
  | 16:12 | <mark> | Setup csw1-sdtpa:11/1 for dataset1 | [production] | 
            
  | 16:06 | <domas> | switched commons master to 5.1, pos:  db31-bin.000001:106 | [production] | 
            
  | 16:06 | <midom> | synchronized php-1.5/wmf-config/db.php | [production] | 
            
  | 16:06 | <midom> | synchronized php-1.5/wmf-config/db.php | [production] | 
            
  | 16:02 | <catrope> | synchronized php-1.5/wmf-config/CommonSettings.php  'Bump style version appendix' | [production] | 
            
  | 16:02 | <catrope> | synchronized php-1.5/extensions/ArticleAssessmentPilot/js/ArticleAssessment.combined.min.js  'r74312' | [production] | 
            
  | 15:52 | <midom> | synchronized php-1.5/wmf-config/db.php  'db27 back' | [production] | 
            
  | 15:52 | <catrope> | synchronized php-1.5/extensions/ArticleAssessmentPilot/js/ArticleAssessment.combined.min.js  'r74310' | [production] | 
            
  | 15:33 | <midom> | synchronized php-1.5/wmf-config/db.php  'db31 in, db27 out' | [production] | 
            
  | 15:25 | <domas> | fixed space on srv178, conf changes made apparmor audit log blow up | [production] | 
            
  | 15:02 | <midom> | synchronized php-1.5/wmf-config/db.php  'db31 mnt' | [production] | 
            
  | 15:00 | <mark> | Restarted Apache on singer | [production] | 
            
  | 14:55 | <mark> | Migrated the Apple Dictionary bridge from yongle to ekrem, and moved the search.wikimedia.org CNAME accordingly | [production] | 
            
  | 14:51 | <mark> | ekrem reboot test | [production] | 
            
  | 13:37 | <mark> | Had puppet install php5-curl on ekrem | [production] | 
            
  | 13:29 | <mark> | Migrated the old mobile (WAP) site from yongle to ekrem and updated the Squid config | [production] | 
            
  | 11:56 | <mark> | Installed Lucid on new server ekrem | [production] | 
            
  | 11:23 | <mark> | Reused public ip address of isidore for new server ekrem | [production] | 
            
  | 10:53 | <mark> | Reinstalled knsq1 as bits varnish server and had it join the esams bits cluster | [production] | 
            
  | 09:34 | <mark> | Removed AS43821 outbound double prepend on BGP session with AS13030 | [production] | 
            
  | 09:30 | <mark> | Moving European bits traffic back to the European cluster | [production] | 
            
  
    | 2010-10-04
      
      § | 
    
  | 19:52 | <catrope> | synchronized php-1.5/wmf-config/CommonSettings.php  'Bump style version appendix' | [production] | 
            
  | 19:52 | <catrope> | synchronized php-1.5/extensions/ArticleAssessmentPilot/js/ArticleAssessment.combined.min.js  'r74268' | [production] | 
            
  | 19:51 | <catrope> | synchronized php-1.5/extensions/UsabilityInitiative/PrefSwitch/SpecialPrefSwitch.php  'r74268' | [production] | 
            
  | 11:57 | <mark> | Stopped PyBal on amslvs4 as a test | [production] | 
            
  | 11:47 | <mark> | synchronized php-1.5/wmf-config/mc.php  'Replace srv87' | [production] | 
            
  | 10:53 | <mark> | Setup BGP state monitoring for csw5-pmtpa and csw1-sdtpa as well | [production] | 
            
  | 10:48 | <mark> | Setup BGP state monitoring for csw1-esams and csw2-esams | [production] | 
            
  | 10:36 | <mark> | Restarted Apache on srv223 | [production] | 
            
  | 10:24 | <mark> | Fixed Nagios by removing db34 from the listed hosts section in conf.php | [production] |