| 2014-05-14
      
      § | 
    
  | 23:42 | <mwalker> | synchronized wmf-config/InitialiseSettings.php  'Poking settings to try and apply them' | [production] | 
            
  | 23:29 | <mwalker> | synchronized visualeditor.dblist  'Another part of {{gerrit|132409}} (visual editor)' | [production] | 
            
  | 23:27 | <K4-713> | updated payments  from 78cc4285bdeb6eecba3efc75e4a04c8b886561e4 to 5e24b953dcff5305099e152139e6e93daba8aeec | [production] | 
            
  | 23:27 | <mwalker> | synchronized wmf-config/  'SWAT of {{gerrit|132409}} (visual editor) and {{gerrit|130274}} (abuse filter)' | [production] | 
            
  | 22:04 | <maxsem> | synchronized php-1.24wmf3/extensions/MobileFrontend/  'bug 65042' | [production] | 
            
  | 22:03 | <marktraceur> | cscott deployed a jenkins job change that pushes parsoid git files to beta-labs for version purposes | [production] | 
            
  | 22:03 | <maxsem> | synchronized php-1.24wmf4/extensions/MobileFrontend/  'bug 65042' | [production] | 
            
  | 20:38 | <awight> | updated crm from 3fd3b94834f94529841ad4a695ecd73c98e487bc to 7a23465e620211739421cce3ad57c62597eb8cc3 | [production] | 
            
  | 20:32 | <bd808> | Restarting logstash on logstash1001.eqiad.wmnet due to missing messages from some (all?) logs | [production] | 
            
  | 19:58 | <demon> | synchronized wmf-config/InitialiseSettings.php  'No more LQT on wikimania2011wiki' | [production] | 
            
  | 18:32 | <Krinkle> | integration-slave1001 had its 8GB / /dev/vda1 100% full. Purging /tmp/perf-*.map brought it back to 41% | [production] | 
            
  | 18:25 | <Krinkle> | integration-slave1001 is having issues writing to disk | [production] | 
            
  | 17:50 | <yurik> | synchronized php-1.24wmf4/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 17:47 | <yurik> | synchronized php-1.24wmf3/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 17:30 | <yurik> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 15:44 | <chasemp> | disabling puppet on tungsten to try tweaking carbon settings to affect queue drops (for the better) | [production] | 
            
  | 14:28 | <cmjohnson1> | mw1053 going down for disk replacement | [production] | 
            
  | 13:27 | <bblack> | restarting pybals on lvs300x | [production] | 
            
  | 12:30 | <_joe_> | restarted uwsgi on tungsten | [production] | 
            
  | 09:46 | <mark> | Started PyBal on lvs300* and established BGP sessions with the routers | [production] | 
            
  | 09:43 | <mark> | Setup BGP configuration for lvs300* on cr1-esams and cr2-knams, with elevated MEDs to keep them as last resorts | [production] | 
            
  | 04:18 | <Tim> | deploying apache configuration change with fixes | [production] | 
            
  | 03:11 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed May 14 03:10:36 UTC 2014 (duration 10m 35s) | [production] | 
            
  | 03:01 | <Tim> | reverting apache change | [production] | 
            
  | 02:53 | <Tim> | deploying apache configuration change https://gerrit.wikimedia.org/r/106109 | [production] | 
            
  | 02:26 | <LocalisationUpdate> | completed (1.24wmf4) at 2014-05-14 02:25:08+00:00 | [production] | 
            
  | 02:21 | <springle> | upgrade db1043, rebuild as m3 master | [production] | 
            
  | 02:14 | <LocalisationUpdate> | completed (1.24wmf3) at 2014-05-14 02:13:23+00:00 | [production] | 
            
  | 00:18 | <manybubbles> | bouncing elasticsearch on elastic1015 to pick up gc logging configuration. it might warn but shouldn't cause any service disrubtion. | [production] | 
            
  
    | 2014-05-13
      
      § | 
    
  | 23:27 | <maxsem> | synchronized php-1.24wmf4/includes/exception/MWException.php  'https://gerrit.wikimedia.org/r/#/c/133184/' | [production] | 
            
  | 23:25 | <maxsem> | synchronized php-1.24wmf3/includes/exception/MWException.php  'https://gerrit.wikimedia.org/r/#/c/133183/' | [production] | 
            
  | 23:21 | <MaxSem> | Ran namespaceDupes after adding new namespaces to zhwikisource - no problems found | [production] | 
            
  | 23:18 | <maxsem> | synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/127584' | [production] | 
            
  | 22:43 | <chasemp> | ms-be1009 rebooted as it had locked up, swift seems to have recoverd | [production] | 
            
  | 22:35 | <mutante> | created new gerrit projects for phabricator,arcanist and libphutil | [production] | 
            
  | 22:23 | <ori> | restarting tungsten to verify fix for gdash/graphite initialization | [production] | 
            
  | 21:33 | <ori> | gdash and graphite currently down; chase & ori debugging | [production] | 
            
  | 21:29 | <manybubbles> | I caused elasticsearch1015 to drop out of the Elasticsearch cluster by tring to take a heap dump on it.  don't do that.  It stops the application for many seconds. | [production] | 
            
  | 19:07 | <yurik> | synchronized php-1.24wmf3/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 19:02 | <yurik> | synchronized php-1.24wmf4/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 18:49 | <cmjohnson1> | replacing failed disk dataset1001 | [production] | 
            
  | 18:25 | <reedy> | synchronized wmf-config/InitialiseSettings.php  'touch for I1681addaed690b652822c0296b7a3e9b84de93b6' | [production] | 
            
  | 18:22 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Non wikipedias to 1.24wmf4 | [production] | 
            
  | 15:52 | <anomie> | synchronized php-1.24wmf4/resources/Resources.php  'SWAT: Deploy jQuery Migrate to 1.24wmf4' | [production] |