| 
      
        2014-02-12
      
      §
     | 
  
    
  | 22:07 | 
  <mutante> | 
  restarting parsoids  | 
  [production] | 
            
  | 21:15 | 
  <gwicke> | 
  updated parsoid to deploy repo 77f4aaf2 and code repo 96c1274 | 
  [production] | 
            
  | 21:02 | 
  <mutante> | 
  DNS update - switch bz.wp to cluster redirect | 
  [production] | 
            
  | 21:00 | 
  <csteipp> | 
  finished scap: bug 60771 (duration: 36m 58s) | 
  [production] | 
            
  | 20:56 | 
  <mwalker> | 
  updating civicrm from 99463ceb353b452a82a7647baa88b59f65e981ea to 935b6dade2c230558c12538ae61dcb3ef18b3efd to try the queueing fix again | 
  [production] | 
            
  | 20:23 | 
  <csteipp> | 
  started scap: bug 60771 | 
  [production] | 
            
  | 20:13 | 
  <mutante|away> | 
  DNS update - lowering bugzilla TTL | 
  [production] | 
            
  | 19:48 | 
  <manybubbles> | 
  when elastic1007 came back Elasticsearch wasn't able to balance shards to my liking so I'm forcing it to shuffle them some by temporarily lowering the disk thresholds to 75/80 instead of 85/95 | 
  [production] | 
            
  | 18:58 | 
  <yurik> | 
  synchronized php-1.23wmf13/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 18:55 | 
  <yurik> | 
  synchronized php-1.23wmf12/extensions/ZeroRatedMobileAccess/ | 
  [production] | 
            
  | 17:45 | 
  <bd808> | 
  Updated scholaships.wm.o to fbffb96; l10n updates | 
  [production] | 
            
  | 17:26 | 
  <ottomata> | 
  purged oracle java 6 from analytics1012 and restarted hadoop daemons | 
  [production] | 
            
  | 17:15 | 
  <demon> | 
  synchronized php-1.23wmf13/extensions/CirrusSearch  'Performance fixes' | 
  [production] | 
            
  | 17:14 | 
  <demon> | 
  synchronized php-1.23wmf12/extensions/CirrusSearch  'Performance fixes' | 
  [production] | 
            
  | 17:14 | 
  <ottomata> | 
  stopping hadoop daemons on an12, oracle java 6 is running there, don't know why yet, apt says it is not installed….grrr | 
  [production] | 
            
  | 16:51 | 
  <awight> | 
  updated crm from 738bce68b56846ee3d493308629beaf743aa8653 to 99463ceb353b452a82a7647baa88b59f65e981ea (revert) | 
  [production] | 
            
  | 14:59 | 
  <manybubbles|away> | 
  just finished in place (Cirrus) reindex of all group1 wikis except commons  | 
  [production] | 
            
  | 08:50 | 
  <akosiaris> | 
  restarted parsoid on wtp1004. After https://gerrit.wikimedia.org/r/112640 is was for some reason listening on 56547 and not 8000. The restart fixed it | 
  [production] | 
            
  | 07:20 | 
  <aaron> | 
  synchronized php-1.23wmf13/includes/filebackend/SwiftFileBackend.php  '288941aa53adffb7de1af8ff4fbae4c1f0c26937 and 1bb7ef5a7816a57b38caa4a302fbff3e53f16d16' | 
  [production] | 
            
  | 06:28 | 
  <Tim> | 
  restarted apache on mw1184 | 
  [production] | 
            
  | 06:06 | 
  <tstarling> | 
  synchronized php-1.23wmf13/includes/specials/SpecialUserrights.php | 
  [production] | 
            
  | 04:48 | 
  <Jeff_Green> | 
  disabling https/smtpd monitoring on iodine | 
  [production] | 
            
  | 04:48 | 
  <Jeff_Green> | 
  disabling mysql monitoring on db48 (prep before starting OTRS upgrade) | 
  [production] | 
            
  | 03:19 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at 2014-02-12 03:19:05+00:00 | 
  [production] | 
            
  | 02:37 | 
  <LocalisationUpdate> | 
  completed (1.23wmf12) at 2014-02-12 02:37:38+00:00 | 
  [production] | 
            
  | 02:35 | 
  <mwalker> | 
  updated fundraising smashpig from 44e8ad85553bfcb4eeb46f67c3c534c5a7c4f8ad to 8a5e194a1c4827fc4fc75a2d6b298d3c30112d90 for queue handling updates | 
  [production] | 
            
  | 02:18 | 
  <LocalisationUpdate> | 
  completed (1.23wmf13) at 2014-02-12 02:18:44+00:00 | 
  [production] | 
            
  | 02:02 | 
  <mwalker> | 
  updating fundraising civicrm from 2c152494487f7a212fca1f501291e050873e6738 to 738bce68b56846ee3d493308629beaf743aa8653 for reporting fix | 
  [production] | 
            
  | 00:36 | 
  <mwalker> | 
  updated fundraising civicrm from 06f7e4d6d6c2653f1d4aef1e8b8e6293a82b39ef to 2c152494487f7a212fca1f501291e050873e6738 for the eventual remove of the _badmsg queues | 
  [production] | 
            
  | 00:03 | 
  <springle> | 
  db1050 alive. do not repool. | 
  [production] | 
            
  
    | 
      
        2014-02-11
      
      §
     | 
  
    
  | 23:17 | 
  <ebernhardson> | 
  synchronized php-1.23wmf13/extensions/Flow | 
  [production] | 
            
  | 23:09 | 
  <ebernhardson> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 23:04 | 
  <ebernhardson> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 22:46 | 
  <maxsem> | 
  synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/112576' | 
  [production] | 
            
  | 22:38 | 
  <ebernhardson> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 22:33 | 
  <ebernhardson> | 
  synchronized php-1.23wmf13/extensions/Flow | 
  [production] | 
            
  | 22:32 | 
  <ebernhardson> | 
  synchronized php-1.23wmf12/extensions/Flow | 
  [production] | 
            
  | 22:23 | 
  <ebernhardson> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 22:19 | 
  <maxsem> | 
  finished scap: Guess what? MobileApp! (duration: 42m 13s) | 
  [production] | 
            
  | 21:56 | 
  <manybubbles> | 
  starting reindex of Cirrus indexes for wikis that got the new deployment today | 
  [production] | 
            
  | 21:37 | 
  <maxsem> | 
  started scap: Guess what? MobileApp! | 
  [production] | 
            
  | 21:06 | 
  <bblack> | 
  libav-tools (libavcodec53, libavformat53, etc) upgraded to 0.8.10-0ubuntu0.12.04.1 on all applicable toollabs hosts | 
  [production] | 
            
  | 20:15 | 
  <bblack> | 
  libav-tools (libavcodec53, libavformat53, etc) upgraded to 0.8.10-0ubuntu0.12.04.1 on all image/video scalers | 
  [production] | 
            
  | 20:05 | 
  <demon> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Move group1 wikis to wmf13 | 
  [production] | 
            
  | 20:00 | 
  <demon> | 
  updated /a/common to {{Gerrit|I7530d4456}}: Revert "Non wikipedias to 1.23wmf12" | 
  [production] | 
            
  | 19:56 | 
  <demon> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Move group2 wikis back to wmf12 where they belong | 
  [production] | 
            
  | 19:28 | 
  <demon> | 
  synchronized wikiversions.cdb  'manually syncing cuz sync-wikiversions is busted for me' | 
  [production] | 
            
  | 19:28 | 
  <demon> | 
  synchronized wikiversions.dat  'manually syncing cuz sync-wikiversions is busted for me' | 
  [production] | 
            
  | 19:26 | 
  <demon> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.23wmf12 | 
  [production] | 
            
  | 19:01 | 
  <reedy> | 
  updated /a/common to {{Gerrit|Iecde9fe5a}}: Set enwiki back to 'All articles needing copy edit' | 
  [production] |