| 2013-01-21
      
      § | 
    
  | 16:29 | <mark> | Rerouted AS43821->AS14907 traffic | [production] | 
            
  | 15:48 | <reedy> | synchronized php-1.21wmf8/includes/EditPage.php | [production] | 
            
  | 15:45 | <reedy> | synchronized php-1.21wmf7/includes/EditPage.php | [production] | 
            
  | 15:32 | <paravoid> | depooling ms-fe1 for testing | [production] | 
            
  | 14:17 | <hashar> | gallium: manually installed pyflakes {{gerrit|44974}} | [production] | 
            
  | 11:10 | <apergos> | nagios was dead over the weekend (config broken), fixed in puppet and on spence, now back in action | [production] | 
            
  | 09:57 | <hashar> | relaying Ryan: he restarted ldap on virt0 (was hung after server restart). nscld was properly falling back to virt1000 but ldap was stuck there too.  DNS got restarted. | [production] | 
            
  | 09:52 | <hashar> | jenkins: jobs refresh completed. | [production] | 
            
  | 08:14 | <hashar> | jenkins: updating all Jenkins jobs based on d31c92e of integration/jenkins-job-builder-config.git | [production] | 
            
  | 05:51 | <Tim> | on marmontel: removed MW-specific packages php5-wmerrors, php-luasandbox, php-wikidiff2 | [production] | 
            
  | 02:50 | <LocalisationUpdate> | completed (1.21wmf8) at Mon Jan 21 02:50:20 UTC 2013 | [production] | 
            
  | 02:27 | <LocalisationUpdate> | completed (1.21wmf7) at Mon Jan 21 02:26:59 UTC 2013 | [production] | 
            
  
    | 2013-01-19
      
      § | 
    
  | 22:24 | <MaxSem> | Created ProofredPage table on aswikisource | [production] | 
            
  | 19:22 | <pgehres> | synchronized wmf-config/reporting-setup.php  'Switching S:FundraiserStatistics read slave back to db1025' | [production] | 
            
  | 02:46 | <LocalisationUpdate> | completed (1.21wmf8) at Sat Jan 19 02:46:06 UTC 2013 | [production] | 
            
  | 02:24 | <LocalisationUpdate> | completed (1.21wmf7) at Sat Jan 19 02:24:18 UTC 2013 | [production] | 
            
  | 01:54 | <binasher> | testing completed, no longer sending live traffic to eqiad | [production] | 
            
  | 01:53 | <binasher> | i was sending >40 reqs/sec from europe and asia to eqiad apaches for the last hour for real world non-english testing | [production] | 
            
  | 00:27 | <mutante> | DNS update - add wikivoyager.org/.de | [production] | 
            
  | 00:08 | <RobH> | blog is fixed, in that its the software equivalent of spinning plates | [production] | 
            
  | 00:04 | <RoanKattouw> | Running git fsck on mediawiki/core.git as nobody on manganese | [production] | 
            
  
    | 2013-01-18
      
      § | 
    
  | 23:42 | <RobH> | blog is partly offline (unreliable loads) investigating | [production] | 
            
  | 23:38 | <RobH> | stupid w3 caching on blog won't let me use new wp-victor directory, has to match old .git name or caching errors result | [production] | 
            
  | 23:34 | <RobH> | blog is being bitchy about new theme versus old caching, reverting to stock and clearing local cache on marmontel | [production] | 
            
  | 23:26 | <RobH> | blog software updated a few hours ago, forgot to log.  just updated theme to git update from gerrit repo. | [production] | 
            
  | 23:21 | <asher> | synchronized wmf-config/CommonSettings.php  'dc specific poolcounter conf' | [production] | 
            
  | 23:17 | <notpeter> | stopping all jobrunners including tmh boxes per asher's request while troubleshooting | [production] | 
            
  | 23:16 | <mutante> | DNS update to add wikimania.asia | [production] | 
            
  | 23:11 | <asher> | synchronized wmf-config  'eqiad/pmtpa config variances' | [production] | 
            
  | 22:37 | <asher> | synchronized wmf-config  'revert' | [production] | 
            
  | 22:36 | <asher> | synchronized wmf-config  'revert' | [production] | 
            
  | 22:34 | <asher> | synchronized wmf-config  'eqiad/pmtpa config variances' | [production] | 
            
  | 20:19 | <root> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 19:49 | <RobH> | authdns-update colby back into sandbox | [production] | 
            
  | 19:08 | <aaron> | synchronized wmf-config/filebackend.php  'Added ceph file backend configuration' | [production] | 
            
  | 19:08 | <root> | Started syncing Wikimedia installation... : | [production] | 
            
  | 19:00 | <mark> | rm -rf /usr/local/apache/common-local on eqiad apaches | [production] | 
            
  | 18:54 | <RobH> | restarted pdns on linne, it borked on authdns-update | [production] | 
            
  | 18:48 | <RobH> | authdns-update | [production] | 
            
  | 18:17 | <root> | Finished syncing Wikimedia installation... : | [production] | 
            
  | 18:04 | <root> | Started syncing Wikimedia installation... : | [production] | 
            
  | 18:02 | <root> | Finished syncing Wikimedia installation... : | [production] |