| 2011-07-28
      
      § | 
    
  | 19:50 | <reedy> | synchronized php-1.17/languages/messages/MessagesKhw.php  '[[rev:93420|r93420]]' | [production] | 
            
  | 19:50 | <reedy> | synchronized php-1.17/languages/messages/MessagesBrh.php  '[[rev:93420|r93420]]' | [production] | 
            
  | 19:49 | <reedy> | synchronized php-1.17/languages/messages/MessagesJam.php  '[[rev:93420|r93420]]' | [production] | 
            
  | 19:49 | <reedy> | synchronized php-1.17/languages/messages/MessagesKs_arab.php  '[[rev:93420|r93420]]' | [production] | 
            
  | 19:41 | <hashar:> | ci.tesla: deleted cc/projects/mw/extensions/FCKeditor directory | [production] | 
            
  | 19:23 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Kill lqt alpha' | [production] | 
            
  | 19:23 | <reedy> | synchronized wmf-config/liquidthreads.php  'Kill lqt alpha' | [production] | 
            
  | 18:50 | <LocalisationUpdate> | completed at Thu Jul 28 18:52:41 UTC 2011 | [production] | 
            
  | 18:46 | <notpeter> | pushing out new dns zone file (only changing cname survey to point to argon.w.o) | [production] | 
            
  | 18:40 | <Reedy> | LocalisationUpdate seems to be working correctly now | [production] | 
            
  | 18:35 | <Reedy> | Fixed localisationupdate for FR, added symlink in /home/wikipedia/l10n/trunk/extensions/FlaggedRevs for the language folder to presentation/language | [production] | 
            
  | 18:32 | <notpeter> | removing survey.w.o from sites enabled on singer for limesurvey migration, and doing a graceful on singer | [production] | 
            
  | 18:22 | <reedy> | synchronized wmf-config/CommonSettings.php  'Remove old ArticleAssessment stuff' | [production] | 
            
  | 18:21 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'Remove old ArticleAssessment stuff' | [production] | 
            
  | 18:14 | <reedy> | synchronized php-1.17/languages/Names.php  '[[rev:93407|r93407]]' | [production] | 
            
  | 18:14 | <reedy> | synchronized php-1.17/includes/DefaultSettings.php  '[[rev:93407|r93407]]' | [production] | 
            
  | 17:44 | <LocalisationUpdate> | failed | [production] | 
            
  | 17:23 | <Reedy> | Manual run of /home/wikipedia/bin/sync-l10nupdate after updated permissions | [production] | 
            
  | 16:56 | <aaron> | synchronized wmf-config/InitialiseSettings.php  'touched file' | [production] | 
            
  | 16:52 | <aaron> | synchronized wmf-config/CommonSettings.php  're-pushed Het Deploy changes with $dbSuffix fix' | [production] | 
            
  | 16:51 | <RobH> | nagios wasnt running, didnt investigate, just restarted service | [production] | 
            
  | 16:44 | <AaronSchulz> | Updated set-group-write2 to handle wmf-config being move up a dir | [production] | 
            
  | 12:45 | <Reedy> | Also, LocalisationUpdate doesn't seem to be logging to /var/log/l10nupdate as it is supposed to | [production] | 
            
  | 12:43 | <Reedy> | Seems LocalisationUpdate may be broken due to permission issues on l10n files on apaches | [production] | 
            
  | 12:39 | <mark> | Replaced SSDs in amssq31 and dist-upgrade | [production] | 
            
  | 12:27 | <mark> | Brought up BGP session to AS 38930 | [production] | 
            
  | 12:21 | <Reedy> | Running l10nupdate manually on fenari | [production] | 
            
  | 12:18 | <Reedy> | Reports of LocalisationUpdate may have stopped working again | [production] | 
            
  | 12:12 | <mark> | Shutdown session to AS 16265 | [production] | 
            
  | 01:18 | <andrewS> | dongle found. reconnected serial to pdu d3-sdtpa. | [production] | 
            
  
    | 2011-07-27
      
      § | 
    
  | 23:47 | <preilly> | pushing bad redirect logging to mobile cluster | [production] | 
            
  | 23:37 | <maplebed> | started reslave from db42 to db1047; poor performance expected for the duration of the sync. | [production] | 
            
  | 23:33 | <notpeter> | restarting torrus again | [production] | 
            
  | 23:19 | <preilly> | pushing badredirect log to mobile cluster | [production] | 
            
  | 22:46 | <notpeter> | upgrading squid and squid-frontend on knsq27 and knsq28 | [production] | 
            
  | 22:13 | <notpeter> | torrus stuck. assuming in deadlock. following instructions for restart | [production] | 
            
  | 22:01 | <AaronSchulz> | Re-installed moodbar & edittracking. Cleaned up wmf-config so that we are on HEAD (but with the reverted stuff still gone) | [production] | 
            
  | 22:00 | <aaron> | synchronizing Wikimedia installation... Revision: 93132: | [production] | 
            
  | 20:19 | <notpeter> | upgrading squid and squid-frontend on knsq29 and knsq30 | [production] | 
            
  | 19:54 | <binasher> | pulled sq78 frontend from lvs | [production] | 
            
  | 19:40 | <Reedy> | Reports of users using non mobile browsers being redirected to mobile sites (enwiki and dewiki) | [production] | 
            
  | 19:04 | <mark> | Temporarily disabled facilities.pp file in puppet, until there is time to debug | [production] | 
            
  | 18:35 | <binasher> | pulled sq78 | [production] | 
            
  | 18:32 | <binasher> | sq78 frontend is in service with mobile redirection | [production] | 
            
  | 17:08 | <binasher> | pulling sq78 from lvs prior to mobile testing | [production] | 
            
  | 16:56 | <aaron> | synchronized multiversion/MWMultiVersion.php  'deployed [[rev:93255|r93255]]' | [production] | 
            
  | 13:40 | <Reedy> | Do not push any configuration change from wmf-config without speaking to Reedy/Ariel first | [production] | 
            
  | 13:33 | <Reedy> | Seems some configuration files between [[rev:2087|r2087]] and [[rev:2088|r2088]] weren't pushed to site, pushing them broke most projects. Aaron to investigate when he's in the office | [production] | 
            
  | 13:20 | <reedy> | synchronized wmf-config/extension-list  '[[rev:2087|r2087]]' | [production] | 
            
  | 13:19 | <reedy> | synchronized wmf-config/liquidthreads.php  '[[rev:2087|r2087]]' | [production] |