| 
      
        2014-02-03
      
      §
     | 
  
    
  | 23:32 | 
  <aaron> | 
  synchronized php-1.23wmf12/includes/filebackend/FileOpBatch.php  'aa3cb6330324ff18ce35fbb68f67b42035de3496' | 
  [production] | 
            
  | 23:29 | 
  <maxsem> | 
  synchronized wmf-config/mobile.php  'https://gerrit.wikimedia.org/r/110087' | 
  [production] | 
            
  | 23:27 | 
  <aaron> | 
  synchronized php-1.23wmf12/includes/filebackend/SwiftFileBackend.php  '1eb5600fe6518071b4c3d2eaa980f70143451be0' | 
  [production] | 
            
  | 23:09 | 
  <springle> | 
  xtrabackup clone db1035 to db1027 | 
  [production] | 
            
  | 22:41 | 
  <springle> | 
  xtrabackup clone db1042 to db1059 | 
  [production] | 
            
  | 22:26 | 
  <bd808> | 
  Forced puppet run on logstash1001 so I could watch the logs as it restarted | 
  [production] | 
            
  | 22:24 | 
  <bd808> | 
  puppetd --enable on logstash1001 | 
  [production] | 
            
  | 21:34 | 
  <bsitu> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Flow on two enwiki WikiProject pages' | 
  [production] | 
            
  | 21:29 | 
  <ottomata> | 
  stopping puppet on cp3021 to test troubleshoot varnishkafka delivery errors with a different change than cp3019 | 
  [production] | 
            
  | 21:27 | 
  <bsitu> | 
  that was not our change, it's previous commit. Ours is "Enable Flow on two enwiki WikiProject pages" | 
  [production] | 
            
  | 21:25 | 
  <bsitu> | 
  updated /a/common to {{Gerrit|I365611ca3}}: Bump wgCacheEpoch for Wikidata | 
  [production] | 
            
  | 21:06 | 
  <ottomata> | 
  stopping puppet on cp3019 to investigate varnishkafka errors | 
  [production] | 
            
  | 20:46 | 
  <bd808> | 
  Disabled puppet on logstash1001 to work around bug 60772 with local config hack | 
  [production] | 
            
  | 20:41 | 
  <reedy> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 20:30 | 
  <reedy> | 
  synchronized php-1.23wmf12/extensions/Wikidata/ | 
  [production] | 
            
  | 20:28 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1049, warm up' | 
  [production] | 
            
  | 20:15 | 
  <awight> | 
  synchronized php-1.23wmf11/extensions/EducationProgram | 
  [production] | 
            
  | 20:11 | 
  <Reedy> | 
  mw1163 seems to be down. No ping/ssh response | 
  [production] | 
            
  | 20:06 | 
  <awight> | 
  synchronized php-1.23wmf12/extensions/EducationProgram | 
  [production] | 
            
  | 20:06 | 
  <awight> | 
  synchronized php-1.23wmf12/extensions/EducationProgram | 
  [production] | 
            
  | 19:51 | 
  <Reedy> | 
  fixed user_last_timestamp column on wikis where it was not "varbinary(14) NULL default NULL" - bug 49196 | 
  [production] | 
            
  | 19:38 | 
  <awight> | 
  crm updated from 95665543297b4f6016e443bcd2194fa5e0f0c96f to ec1e1fc75193ac8c0e6237fc0b80f58b3f8d55fc | 
  [production] | 
            
  | 19:34 | 
  <manybubbles1> | 
  removed elastic1007 from the elasticsearch cluster because it crashed again unexpectedly | 
  [production] | 
            
  | 19:33 | 
  <gwicke> | 
  deployed parsoid deploy 855eeb06 with source 4d5d9a0a | 
  [production] | 
            
  | 19:11 | 
  <Reedy> | 
  Added org_last_active_date column to ep_orgs on all wikis running EducationProgram - bug 60775 | 
  [production] | 
            
  | 06:56 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1049 for schema changes' | 
  [production] | 
            
  | 05:44 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1051, warm up' | 
  [production] | 
            
  | 03:40 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1051 for schema changes' | 
  [production] | 
            
  | 03:29 | 
  <springle> | 
  synchronized wmf-config/db-pmtpa.php  'depool db1052 for schema changes' | 
  [production] | 
            
  | 02:15 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at 2014-02-03 02:15:14+00:00 | 
  [production] | 
            
  | 02:06 | 
  <LocalisationUpdate> | 
  completed (1.23wmf12) at 2014-02-03 02:06:16+00:00 | 
  [production] | 
            
  | 02:06 | 
  <LocalisationUpdate> | 
  completed (1.23wmf11) at 2014-02-03 02:03:45+00:00 | 
  [production] | 
            
  | 02:06 | 
  <Reedy> | 
  wmflabs bastion /home is giving "Read-only file system" | 
  [production] | 
            
  | 01:27 | 
  <springle> | 
  synchronized wmf-config/db-pmtpa.php  'rotate s4 master db1059 to db1040' | 
  [production] | 
            
  | 01:26 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'rotate s4 master db1059 to db1040' | 
  [production] | 
            
  | 01:08 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'prepare for s4 master rotation db1059 to db1040' | 
  [production] | 
            
  
    | 
      
        2014-02-02
      
      §
     | 
  
    
  | 22:01 | 
  <ori> | 
  synchronized tests/noc-conf/highlightTest.php  'I8352c4cfc: Fix test broken by Idda8cff80 (2/2)' | 
  [production] | 
            
  | 21:59 | 
  <ori> | 
  synchronized docroot/noc/conf/highlight.php  'I8352c4cfc: Fix test broken by Idda8cff80 (1/2)' | 
  [production] | 
            
  | 21:58 | 
  <ori> | 
  updated /a/common to {{Gerrit|I8352c4cfc}}: Fix test broken by Idda8cff80 | 
  [production] | 
            
  | 21:40 | 
  <ori> | 
  synchronized docroot/noc/conf/highlight.php  'Idda8cff80: Replace easter egg by a more explaining message' | 
  [production] | 
            
  | 21:37 | 
  <ori> | 
  updated /a/common to {{Gerrit|Idda8cff80}}: Replace easter egg by a more explaining message | 
  [production] | 
            
  | 20:20 | 
  <awight_> | 
  enabling campaigns: C14_enWW_frm_FR C13_wpdr_enSG_FR C13_wpnd_mlotWW_FR C13_wpnd_zhCN_FR C13_wpnd_mlWW_FR | 
  [production] | 
            
  | 19:03 | 
  <awight_> | 
  disabled campaigns: C14_enWW_frm_FR C13_wpdr_enSG_FR C13_wpnd_mlotWW_FR C13_wpnd_zhCN_FR C13_wpnd_mlWW_FR | 
  [production] | 
            
  | 18:15 | 
  <awight_> | 
  stomp updated from 0fa5283c938b2a551278467371acdf4b491f82de to 361c21946fae4eb91e86ffcf886d7f9b388e1289 | 
  [production] | 
            
  | 15:14 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1037 and db1004' | 
  [production] | 
            
  | 10:53 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1037, schema changes' | 
  [production] | 
            
  | 09:52 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'depool db1004, schema changes' | 
  [production] | 
            
  | 05:47 | 
  <springle> | 
  synchronized wmf-config/db-eqiad.php  'repool db1011, warm up' | 
  [production] | 
            
  | 03:51 | 
  <LocalisationUpdate> | 
  ResourceLoader cache refresh completed at 2014-02-02 03:50:59+00:00 | 
  [production] | 
            
  | 03:11 | 
  <LocalisationUpdate> | 
  completed (1.23wmf12) at 2014-02-02 03:11:33+00:00 | 
  [production] |