| 
      
        2013-10-10
      
      §
     | 
  
    
  | 17:34 | 
  <reedy> | 
  Finished syncing Wikimedia installation... : testwiki to 1.22wmf21 and build and sync l10ncache | 
  [production] | 
            
  | 17:16 | 
  <reedy> | 
  Started syncing Wikimedia installation... : testwiki to 1.22wmf21 and build and sync l10ncache | 
  [production] | 
            
  | 17:06 | 
  <reedy> | 
  synchronized docroot and w | 
  [production] | 
            
  | 17:03 | 
  <reedy> | 
  synchronized php-1.22wmf21  'staging' | 
  [production] | 
            
  | 15:46 | 
  <mark> | 
  Imported firewall ACLs on cr2-ulsfo, activated on lo0.0 | 
  [production] | 
            
  | 15:46 | 
  <mark> | 
  Configured cr2-ulsfo:ae1 with all sub interfaces and VRRP | 
  [production] | 
            
  | 15:12 | 
  <hashar> | 
  jenkins : triggering operations-puppet-rspec (non voting) on operations/puppet.git {{gerrit|89000}} | 
  [production] | 
            
  | 15:04 | 
  <andrewbogott> | 
  removed mysql-server-5.5 package from stat1 to ensure that it doesn't get used now that it's no longer maintained by puppet. | 
  [production] | 
            
  | 15:01 | 
  <mark> | 
  Corrected wrong interface addresses on cr1-ulsfo:ae0 sub-units | 
  [production] | 
            
  | 14:38 | 
  <mark> | 
  Setup iBGP between cr1-ulsfo and cr2-ulsfo | 
  [production] | 
            
  | 14:38 | 
  <mark> | 
  Configured AS65003 ulsfo BGP confederation on cr1-ulsfo and cr2-ulsfo | 
  [production] | 
            
  | 14:25 | 
  <mark> | 
  Setup OSPF and OSPF3 on cr1-ulsfo:ae0.2 <--> cr2-ulsfo:ae0.2 | 
  [production] | 
            
  | 14:24 | 
  <mark> | 
  Setup cr1-ulsfo:ae0 <--> cr2-ulsfo:ae0 | 
  [production] | 
            
  | 12:04 | 
  <mark> | 
  Rebooting scs-ulsfo, pmshell is segfaulting | 
  [production] | 
            
  | 11:52 | 
  <akosiaris> | 
  upgraded php5 packages from php5_5.3.10-1ubuntu3.6+wmf1 to php5_5.3.10-1ubuntu3.8+wmf1 on apt.wikimedia.org | 
  [production] | 
            
  | 08:27 | 
  <ariel> | 
  synchronized wmf-config/db-eqiad.php  'depool db1024 (s7) for conversion to mariadb' | 
  [production] | 
            
  | 08:16 | 
  <ariel> | 
  synchronized wmf-config/db-eqiad.php  'db1039 (s7) to normal weight in pool' | 
  [production] | 
            
  | 06:50 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'warm up db1039 in s7' | 
  [production] | 
            
  | 05:16 | 
  <springle> | 
  start xtrabackup clone db1039 to db1007 | 
  [production] | 
            
  | 04:19 | 
  <springle> | 
  upgrading db1007 to precise + mariadb | 
  [production] | 
            
  | 02:28 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Thu Oct 10 02:28:22 UTC 2013 | 
  [production] | 
            
  | 02:18 | 
  <LocalisationUpdate> | 
  completed (1.22wmf19) at Thu Oct 10 02:18:06 UTC 2013 | 
  [production] | 
            
  
    | 
      
        2013-10-09
      
      §
     | 
  
    
  | 16:40 | 
  <RobH> | 
  puppetmaster was overloaded and returning 500s, tried killing open processes and restarting puppetmaster on stafford | 
  [production] | 
            
  | 13:19 | 
  <springle> | 
  start dump db1007 to db1039 for S7 file per table | 
  [production] | 
            
  | 10:57 | 
  <mark> | 
  Non-Wikipedia projects are now on Varnish for eqiad non-ipv6, non-https traffic | 
  [production] | 
            
  | 09:34 | 
  <hashar> | 
  jenkins back up | 
  [production] | 
            
  | 09:10 | 
  <hashar> | 
  gallium : zuul backup, waiting for jenkins to complete start up | 
  [production] | 
            
  | 08:24 | 
  <ori-l> | 
  Stopping EventLogging, then rebooting vanadium for kernel upgrade | 
  [production] | 
            
  | 08:02 | 
  <hashar> | 
  rebooting gallium | 
  [production] | 
            
  | 07:18 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1022 in S6. move db1039 to assist with upgrades in S7. depool db1007 for upgrade' | 
  [production] | 
            
  | 06:12 | 
  <aaron> | 
  synchronized php-1.22wmf19/includes  'c6d64f5488c124636ab46712e1d104e5c7076325' | 
  [production] | 
            
  | 02:45 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at Wed Oct  9 02:44:59 UTC 2013 | 
  [production] | 
            
  | 02:30 | 
  <LocalisationUpdate> | 
  completed (1.22wmf19) at Wed Oct  9 02:30:06 UTC 2013 | 
  [production] | 
            
  | 02:16 | 
  <LocalisationUpdate> | 
  completed (1.22wmf20) at Wed Oct  9 02:16:08 UTC 2013 | 
  [production] | 
            
  | 00:52 | 
  <krinkle> | 
  synchronized php-1.22wmf19/extensions/VisualEditor  'I03d68280ddd9506' | 
  [production] | 
            
  | 00:49 | 
  <krinkle> | 
  synchronized php-1.22wmf10/extensions/VisualEditor  'I85bce4d40e430318' | 
  [production] | 
            
  
    | 
      
        2013-10-08
      
      §
     | 
  
    
  | 23:29 | 
  <mflaschen> | 
  synchronized php-1.22wmf20/extensions/GettingStarted/  'Deploy GettingStarted to wmf20 for A/B test' | 
  [production] | 
            
  | 23:29 | 
  <mflaschen> | 
  synchronized php-1.22wmf19/extensions/GettingStarted/  'Deploy GettingStarted to wmf19 for A/B test' | 
  [production] | 
            
  | 23:28 | 
  <mflaschen> | 
  synchronized wmf-config/InitialiseSettings.php  'A/B test for GettingStarted' | 
  [production] | 
            
  | 23:27 | 
  <mflaschen> | 
  synchronized wmf-config/CommonSettings.php  'A/B test for GettingStarted' | 
  [production] | 
            
  | 22:26 | 
  <cmjohnson1> | 
  reinstalling amssq48-62 | 
  [production] | 
            
  | 22:25 | 
  <LeslieCarr> | 
  moved fxp0 on cr1-esams into MGMT logical system | 
  [production] | 
            
  | 21:44 | 
  <aaron> | 
  synchronized php-1.22wmf20/includes/LinksUpdate.php  '337272176758b06c0ed9fd8859d358730152c155' | 
  [production] | 
            
  | 21:40 | 
  <aaron> | 
  synchronized php-1.22wmf20/includes/WikiPage.php  '337272176758b06c0ed9fd8859d358730152c155' | 
  [production] | 
            
  | 20:27 | 
  <maxsem> | 
  synchronized php-1.22wmf20/extensions/MobileFrontend/javascripts/loggingSchemas/MobileWebClickTracking.js | 
  [production] | 
            
  | 20:05 | 
  <maxsem> | 
  synchronized php-1.22wmf19/extensions/MobileFrontend/javascripts/loggingSchemas/MobileWebClickTracking.js | 
  [production] | 
            
  | 19:16 | 
  <bsitu> | 
  synchronized php-1.22wmf19/extensions/Echo  'Touch Js file' | 
  [production] | 
            
  | 19:11 | 
  <bsitu> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Echo and Thanks on various wikis' | 
  [production] | 
            
  | 19:06 | 
  <bsitu> | 
  synchronized echowikis.dblist  'Enable Echo and Thanks on various wikis' | 
  [production] | 
            
  | 19:06 | 
  <bsitu> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Echo and Thanks on various wikis' | 
  [production] |