| 2012-07-11
      
      § | 
    
  | 21:01 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 20:16 | <reedy> | synchronized php-1.20wmf7/extensions/CentralNotice | [production] | 
            
  | 19:33 | <cmjohnson1> | db10 swapping disk1 out rt3251 | [production] | 
            
  | 19:33 | <RobH> | shutting down srv203 for hardware checking per rt3110 | [production] | 
            
  | 19:12 | <hashar> | finally stopped using my production ssh key on labs. | [production] | 
            
  | 19:11 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikiquote and wikiversity to 1.20wmf7 | [production] | 
            
  | 19:08 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks and wikinews to 1.20wmf7 | [production] | 
            
  | 19:06 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: wiktionary and wikisource to 1.20wmf7 | [production] | 
            
  | 19:03 | <cmjohnson1> | search35 shutting down to reseat DIMM rt-3260 | [production] | 
            
  | 18:29 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Switch special, private and closed wikis from 1.20wmf6 to 1.20wmf7 | [production] | 
            
  | 15:16 | <robh> | synchronized wmf-config/mc.php  'moving srv208 to down' | [production] | 
            
  | 15:14 | <robh> | synchronized wmf-config/mc.php | [production] | 
            
  | 14:30 | <cmjohnson1> | shutting down search32 to reseat DIMM rt-3076 | [production] | 
            
  | 11:16 | <mutante> | yay @ svn removal | [production] | 
            
  | 11:13 | <hashar> | /home/wikipedia/conf/httpd cleaned out the svn repository. That directory is now 100% under git tracking yeah!!! Thanks TIm! | [production] | 
            
  | 11:11 | <mutante> | rebooting srv266 | [production] | 
            
  | 11:05 | <mutante> | purged wikipedie.cz/Experti_na_prirodu URLs with purgeList.php | [production] | 
            
  | 10:52 | <mutante> | apache-graceful-all | [production] | 
            
  | 10:48 | <mutante> | sync-apache to push fixed wikipedie.cz redirect | [production] | 
            
  | 08:36 | <hashar> | synced /h/w/conf/httpd git and svn repositories | [production] | 
            
  | 08:33 | <mutante> | chmod -R g+w /home/wikipedia/conf/httpd on fenari to fix group write on .git/objects | [production] | 
            
  | 07:59 | <mutante> | srv266 - package/kernel upgrades | [production] | 
            
  | 07:35 | <mutante> | powercycled downed owa3, installed kernel upgrades on owa1-3 (but they are also waiting to be repurposed, RT-2511)exit | [production] | 
            
  | 04:05 | <Tim> | on hume: running updateCollation.php --dry-run on ptwiki to determine whether there will be any key truncation issues with [[bugzilla:35632|bug 35632]] | [production] | 
            
  | 02:48 | <LocalisationUpdate> | completed (1.20wmf7) at Wed Jul 11 02:48:18 UTC 2012 | [production] | 
            
  | 02:25 | <LocalisationUpdate> | completed (1.20wmf6) at Wed Jul 11 02:25:19 UTC 2012 | [production] | 
            
  
    | 2012-07-10
      
      § | 
    
  | 23:47 | <AaronSchulz> | Doing shards c-f | [production] | 
            
  | 23:47 | <maplebed> | put two new swift front ends into rotation ms-fe3 and ms-fe4 | [production] | 
            
  | 23:40 | <AaronSchulz> | Doing shards 8-b | [production] | 
            
  | 23:34 | <AaronSchulz> | Doing shards 4-7 | [production] | 
            
  | 23:31 | <AaronSchulz> | copyFileBackend.php run rate for above processes is at /home/aaron/NFStoSwiftCopyRate, currently 50 | [production] | 
            
  | 23:26 | <AaronSchulz> | Running copyFileBackend.php for zhwiki public zone shards 0-3 on hume | [production] | 
            
  | 23:20 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 22:17 | <reedy> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 22:12 | <asher> | synchronized wmf-config/CommonSettings.php  'moving parsercache from db40 to pc1' | [production] | 
            
  | 22:05 | <maplebed> | put swift backends ms-be9-12 in rotation for containers (weight 30) and objects (weight 5) | [production] | 
            
  | 21:17 | <maplebed> | rebooting new ms-be6-8 to change BIOS setting to boot from disk | [production] | 
            
  | 20:26 | <mlitn> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 20:26 | <RobH> | shutting down sq36 for hardware troubleshooting | [production] | 
            
  | 19:38 | <LeslieCarr> | restarted frozen pdns on ns2 | [production] | 
            
  | 19:28 | <mlitn> | Started syncing Wikimedia installation... : | [production] | 
            
  | 19:15 | <cmjohnson1> | sq36-requires a hard shutdown-unresponsive to mgmt. rt-3254 | [production] | 
            
  | 19:05 | <RoanKattouw> | chmod g+w /home/wikipedia/common/php-1.20wmf7/cache/l10n/ | [production] | 
            
  | 19:03 | <RoanKattouw> | chown l10nupdate:wikidev /home/wikipedia/common/php-1.20wmf7/cache/l10n/ | [production] | 
            
  | 18:58 | <hashar> | reworked the git repository in /home/wikipedia/conf/httpd , manually synced changes from svn to the git repo | [production] | 
            
  | 18:12 | <RobH> | srv266 shutdown for chris | [production] | 
            
  | 18:06 | <cmjohnson1> | srv266 being brought down for an extended period of time to run diagnostic tests | [production] | 
            
  | 17:25 | <cmjohnson1> | srv266 shutting down for HW troubleshooting rt-2896 | [production] | 
            
  | 16:33 | <mutante> | package upgrades and kernel on niobium | [production] | 
            
  | 16:28 | <mutante> | powercycling niobium | [production] |