| 2012-04-04
      
      § | 
    
  | 22:14 | <py> | synchronized wmf-config/lucene.php  'pointing all search back to pmtpa' | [production] | 
            
  | 22:13 | <notpeter> | flipping all search back to pmtpa (until tomorrow...) | [production] | 
            
  | 22:00 | <catrope> | synchronized php-1.19/extensions/ArticleFeedback  '[[rev:114717|r114717]]' | [production] | 
            
  | 21:24 | <cmjohnson1> | replacing power cable to psu1 (bottom) es1 | [production] | 
            
  | 21:22 | <cmjohnson1> | replacing power cable to psu1 (top) es1 | [production] | 
            
  | 21:14 | <py> | synchronized wmf-config/lucene.php  'pointing de, fr, and ja search at lvs pool in eqiad for live testing' | [production] | 
            
  | 21:12 | <notpeter> | moving de, fr, and ja search to eqiad | [production] | 
            
  | 21:04 | <cmjohnson1> | replacing power cable on labstore2 array psu2 (right side) | [production] | 
            
  | 21:00 | <cmjohnson1> | replacing power cable on labstore1 array psu1 (left side) | [production] | 
            
  | 20:57 | <cmjohnson1> | removing power from bottom power supply labstore 2 | [production] | 
            
  | 20:54 | <cmjohnson1> | removing power from top power supply on labstore2 | [production] | 
            
  | 19:44 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Enable wmgArticleFeedbackv5AbuseFiltering on enwiki' | [production] | 
            
  | 19:40 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Disable wmgArticleFeedbackv5AbuseFiltering on enwiki' | [production] | 
            
  | 19:14 | <awjrichards> | synchronized php/extensions/MobileFrontend/MobileFrontend.body.php  '[[rev:114716|r114716]]' | [production] | 
            
  | 19:12 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Enable wmgArticleFeedbackv5AbuseFiltering on enwiki' | [production] | 
            
  | 19:04 | <RobH> | dns update for zhen mgmt | [production] | 
            
  | 18:54 | <catrope> | synchronizing Wikimedia installation... : Deploying AFTv5 update | [production] | 
            
  | 18:52 | <py> | synchronized wmf-config/lucene.php  'pointing ru, nl, pl, pt, zh, and sv search at lvs pool in eqiad for live testing' | [production] | 
            
  | 18:51 | <notpeter> | moving ru, nl, pl, pt, zh, and sv search to eqiad | [production] | 
            
  | 18:27 | <mutante> | nuked /a contents on es1004, started rsync from es1001 | [production] | 
            
  | 18:16 | <catrope> | synchronized wmf-config/CommonSettings.php  'Add code for wmgArticleFeedbackv5AbuseFiltering' | [production] | 
            
  | 18:16 | <catrope> | synchronized wmf-config/InitialiseSettings.php  'Add wmgArticleFeedbackv5AbuseFiltering, enabled on testwiki only' | [production] | 
            
  | 17:55 | <RoanKattouw> | Running AFTv5 schema changes on enwiki | [production] | 
            
  | 17:47 | <RobH> | i didnt crash the site, weeee | [production] | 
            
  | 17:46 | <RobH> | gracefully restarting apaches | [production] | 
            
  | 17:46 | <RobH> | pushing out redirects change to apaches for wikipedia.org/com.il redirect to he.wikipedia.org | [production] | 
            
  | 17:41 | <binasher> | started enwiki.revision sha1 migration on db53 | [production] | 
            
  | 17:38 | <asher> | synchronized wmf-config/db.php  'returning db52, pulling db53' | [production] | 
            
  | 17:32 | <RobH> | update done, all nameservers still online | [production] | 
            
  | 17:31 | <RobH> | dns update for wikipedia.org/com.il being resolved | [production] | 
            
  | 17:08 | <RoanKattouw> | Applying AFTv5 schema change on testwik | [production] | 
            
  | 15:30 | <py> | synchronized wmf-config/lucene.php  'pointing eswiki search at lvs pool in eqiad for live testing' | [production] | 
            
  | 15:28 | <notpeter> | pointing eswiki search at eqiad | [production] | 
            
  | 12:51 | <mutante> | db1007 - add mysql startup via 'update-rc.d mysql defaults' | [production] | 
            
  | 12:42 | <apergos> | started mysqld on db1007 via /etc/init.d/mysql (this doesn't seem to point to a special fb build, and can't seem to find one on this host, what's up with that?) | [production] | 
            
  | 12:31 | <apergos> | rebooted bd1007, it was dead in the water (also no helpful messages on console, bah) | [production] | 
            
  | 11:17 | <mutante> | enabled Renameuser extension on wikitech, renamed tchay per RT request, disabled extension again (it was installed but disabled) | [production] | 
            
  | 02:19 | <LocalisationUpdate> | completed (1.19) at Wed Apr  4 02:19:03 UTC 2012 | [production] | 
            
  | 01:50 | <aaron> | synchronized php-1.19/includes/filerepo/backend/FileOp.php  'deployed [[rev:114697|r114697]]' | [production] | 
            
  | 01:39 | <preilly> | synchronized php-1.19/extensions/ZeroRatedMobileAccess/ZeroRatedMobileAccess.body.php  'changes for zero needed for carrier testing header of landing page only for mswiki' | [production] | 
            
  
    | 2012-04-03
      
      § | 
    
  | 23:17 | <LeslieCarr> | updating bgp policies on cr1.sdtpa | [production] | 
            
  | 22:44 | <LeslieCarr> | reinstalling neon | [production] | 
            
  | 22:04 | <maplebed> | rolled back changes to emery in udp-filter due to the new binary crashing. | [production] | 
            
  | 21:50 | <maplebed> | ran /etc/init.d/udp2log reload on emery to enact the puppetted changes | [production] | 
            
  | 21:41 | <maplebed> | deploying new udp-filter and teahouse filters to emery for diederik | [production] | 
            
  | 20:13 | <notpeter> | restarting lsearchd on search7. was taosted | [production] | 
            
  | 18:37 | <root> | synchronized wmf-config/mc.php | [production] | 
            
  | 18:37 | <RobH> | syncing new mc.php, forgot to check for all three of the servers i took down, opps. | [production] | 
            
  | 18:28 | <RobH> | shutting down mw28, mw49, & mw58 for rack relocation due to power overload in d2-pmtpa, relocation to d1-sdtpa per rt 2692 | [production] | 
            
  | 17:59 | <K4-713> | Synchronized payments cluster to [[rev:114642|r114642]] | [production] |