| 2013-08-29
      
      § | 
    
  | 17:12 | <csteipp> | synchronized php-1.22wmf14/includes/api  'bug49090' | [production] | 
            
  | 16:56 | <reedy> | synchronized docroot and w | [production] | 
            
  | 16:56 | <reedy> | synchronized php-1.22wmf15/ | [production] | 
            
  | 15:43 | <MaxSem> | Recreating Solr index | [production] | 
            
  | 14:46 | <ottomata> | restarting gmetad on nickel to see if I can get it to pick up reinstalled analytics  boxes | [production] | 
            
  | 09:39 | <springle> | killing long-running research transaction on db1047, and setting innodb_max_purge_lag to reduce history list length | [production] | 
            
  | 09:32 | <mark> | Powercycled lanthanum | [production] | 
            
  | 08:52 | <hashar> | rebooting lanthanum.eqiad.wmnet (high sys cpu) | [production] | 
            
  | 08:33 | <hashar> | apt-get upgrade on gallium.wikimedia.org | [production] | 
            
  | 08:29 | <hashar> | apt-get upgrade on lanthanum.eqiad.wmnet | [production] | 
            
  | 07:27 | <springle> | relaxed slave delay warnings to warn 150 crit 300 | [production] | 
            
  | 02:40 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Thu Aug 29 02:40:47 UTC 2013 | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.22wmf13) at Thu Aug 29 02:26:16 UTC 2013 | [production] | 
            
  | 02:14 | <LocalisationUpdate> | completed (1.22wmf14) at Thu Aug 29 02:14:03 UTC 2013 | [production] | 
            
  | 01:40 | <mwalker> | fundraising delete query on db1025 ran 1:10minutes -- serious lag on db1008 and db43 now expected for same | [production] | 
            
  | 00:30 | <mwalker> | clearing ~14M rows from db1025.pgehres.bannerimpressions and bannerimpression_raw | [production] | 
            
  
    | 2013-08-28
      
      § | 
    
  | 23:28 | <bsitu> | synchronized wmf-config/InitialiseSettings.php  'Disable the job queue that processes echo notification' | [production] | 
            
  | 23:16 | <rmoen> | synchronized php-1.22wmf14/extensions/VisualEditor/  'Update VisualEditor to master' | [production] | 
            
  | 22:48 | <demon> | synchronized php-1.22wmf14/extensions/CentralAuth | [production] | 
            
  | 22:47 | <demon> | synchronized php-1.22wmf13/extensions/CentralAuth | [production] | 
            
  | 20:40 | <demon> | synchronized wmf-config/InitialiseSettings.php  'All wikis to secure login' | [production] | 
            
  | 20:36 | <demon> | Finished syncing Wikimedia installation... : Secure login on alllllll the wikis | [production] | 
            
  | 20:23 | <demon> | Started syncing Wikimedia installation... : Secure login on alllllll the wikis | [production] | 
            
  | 19:29 | <awight> | synchronized php-1.22wmf14/extensions/CentralNotice  'Updating CentralNotice to wmf_deploy' | [production] | 
            
  | 19:28 | <awight> | synchronized php-1.22wmf13/extensions/CentralNotice  'Updating CentralNotice to wmf_deploy' | [production] | 
            
  | 18:36 | <csteipp> | synchronized php-1.22wmf13/extensions/Wikibase | [production] | 
            
  | 18:35 | <csteipp> | synchronized php-1.22wmf13/extensions/CheckUser | [production] | 
            
  | 18:34 | <csteipp> | synchronized php-1.22wmf14/extensions/CheckUser | [production] | 
            
  | 18:34 | <csteipp> | synchronized php-1.22wmf14/extensions/Wikibase | [production] | 
            
  | 18:32 | <csteipp> | synchronized php-1.22wmf14/extensions/OAuth | [production] | 
            
  | 17:48 | <ottomata> | restarting some datanodes | [production] | 
            
  | 17:46 | <reedy> | synchronized php-1.22wmf14/extensions/CirrusSearch/  'Fix bug 53487' | [production] | 
            
  | 16:48 | <demon> | synchronized php-1.22wmf14/extensions/CirrusSearch/forceSearchIndex.php  'Fix for reindexer' | [production] | 
            
  | 16:46 | <demon> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 16:25 | <demon> | synchronized wmf-config/InitialiseSettings.php  'Move mw.org to primary backend as Cirrus to test my theory' | [production] | 
            
  | 16:20 | <Reedy> | Created EducationProgram tables on ptwiki | [production] | 
            
  | 16:07 | <^d> | ES: indexing mediawikiwiki in screen on terbium | [production] | 
            
  | 16:07 | <^d> | ES: created mediawikiwiki index | [production] | 
            
  | 16:05 | <demon> | synchronized wmf-config/InitialiseSettings.php  'CirrusSearch on mediawiki.org \\o/' | [production] | 
            
  | 15:46 | <gwicke> | updated Parsoid to ca3f45f | [production] | 
            
  | 15:39 | <demon> | synchronized php-1.22wmf14/extensions/CirrusSearch  'CirrusSearch to master' | [production] | 
            
  | 15:02 | <springle> | restarting slave threads on db55, db58, db43. will lag for a while. | [production] | 
            
  | 14:34 | <paravoid> | authdns-update: switching Middle-East to esams | [production] | 
            
  | 14:15 | <paravoid> | authdns-update: switching Africa to esams | [production] | 
            
  | 13:58 | <hashar> | jenkins: renamed OAuth jobs from Oauth to OAuth | [production] | 
            
  | 13:55 | <hashar> | jenkins: renamed Editcount jobs from EditCount to Editcount | [production] | 
            
  | 13:43 | <springle> | same purge situation for db58 and db43, and remedy | [production] | 
            
  | 13:35 | <springle> | stopped db55 slave threads while purge catches up; killed long running research user transaction apparently doing nothing but holding locks | [production] | 
            
  | 13:20 | <springle> | temporarily changing innodb purge settings on db55 (massive growing history list) | [production] | 
            
  | 12:32 | <hashar> | jenkins: updated various jobs to use $ZUUL_PROJECT when determining the git repository to fetch from {{bug|53470}} | [production] |