| 
      
        2013-02-13
      
      §
     | 
  
    
  | 23:11 | 
  <RobH> | 
  db1013 online and puppet updated, needs to be pushed into some db cluster service | 
  [production] | 
            
  | 22:45 | 
  <RobH> | 
  mw27 locked up, powercycling | 
  [production] | 
            
  | 22:36 | 
  <notpeter> | 
  powercycling all eqiad jobrunners | 
  [production] | 
            
  | 22:13 | 
  <RobH> | 
  adding mw1201-1208 to eqiad apache pool | 
  [production] | 
            
  | 21:44 | 
  <Reedy> | 
  Running sync-common on mw1203 | 
  [production] | 
            
  | 21:43 | 
  <reedy> | 
  synchronized php-1.21wmf9  'resync to fix file permission errors' | 
  [production] | 
            
  | 21:32 | 
  <Reedy> | 
  Running sync-common on mw1204 | 
  [production] | 
            
  | 21:30 | 
  <Reedy> | 
  Running sync-common on mw1202 | 
  [production] | 
            
  | 21:27 | 
  <RobH> | 
  db27 rebooting for reinstallation | 
  [production] | 
            
  | 21:27 | 
  <RobH> | 
  db29 offline due to hardware issue, related ticket 4526 | 
  [production] | 
            
  | 21:19 | 
  <reedy> | 
  synchronized wmf-config/CommonSettings.php | 
  [production] | 
            
  | 21:11 | 
  <csteipp> | 
  synchronized wmf-config | 
  [production] | 
            
  | 21:09 | 
  <reedy> | 
  cleared profiling data | 
  [production] | 
            
  | 20:25 | 
  <reedy> | 
  synchronized wmf-config/CommonSettings.php  'Uncommenting enwiki from localClientDatabases' | 
  [production] | 
            
  | 19:59 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable Wikibase Client on enwiki' | 
  [production] | 
            
  | 19:47 | 
  <reedy> | 
  synchronized php-1.21wmf9/extensions/Wikibase/ | 
  [production] | 
            
  | 19:45 | 
  <siebrand> | 
  test for timestamp. | 
  [production] | 
            
  | 19:30 | 
  <aaron> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: Moved remaning wikis to 1.21wmf9 | 
  [production] | 
            
  | 19:21 | 
  <aaron> | 
  synchronized php-1.21wmf9/maintenance/runJobs.php  'deployed b03384f0ebd95e7f79638fb14ccd55da9c186d97' | 
  [production] | 
            
  | 19:12 | 
  <py> | 
  gracefulled all apaches | 
  [production] | 
            
  | 18:59 | 
  <cmjohnson1> | 
  mw1041 is borked and will be powered down and removed from network for h/w checks | 
  [production] | 
            
  | 18:27 | 
  <aaron> | 
  synchronized php-1.21wmf9/extensions/TranslationNotifications  'deployed d7bf60b57f472e5f75101f58505f61842848f961' | 
  [production] | 
            
  | 16:26 | 
  <Nemo_bis> | 
  Job queue weirdness and TranslationNotifications duplicates again noticed on Meta ([[bugzilla:42715|bug 42715]]) | 
  [production] | 
            
  | 13:33 | 
  <reedy> | 
  synchronized php-1.21wmf9/resources/mediawiki | 
  [production] | 
            
  | 09:17 | 
  <maxsem> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend  'https://gerrit.wikimedia.org/r/#/c/48804/' | 
  [production] | 
            
  | 09:10 | 
  <maxsem> | 
  synchronized php-1.21wmf8/extensions/MobileFrontend  'https://gerrit.wikimedia.org/r/#/c/48804/' | 
  [production] | 
            
  | 08:52 | 
  <maxsem> | 
  synchronized php-1.21wmf8/extensions/MobileFrontend  'https://gerrit.wikimedia.org/r/#/c/48797/' | 
  [production] | 
            
  | 08:25 | 
  <hashar> | 
  jenkins: changing encryption key and regenerating secrets. See {{bug|44592}} | 
  [production] | 
            
  | 05:50 | 
  <tstarling> | 
  synchronized multiversion/MWScript.php | 
  [production] | 
            
  | 02:52 | 
  <LocalisationUpdate> | 
  completed (1.21wmf8) at Wed Feb 13 02:52:39 UTC 2013 | 
  [production] | 
            
  | 02:28 | 
  <LocalisationUpdate> | 
  completed (1.21wmf9) at Wed Feb 13 02:28:06 UTC 2013 | 
  [production] | 
            
  | 00:42 | 
  <notpeter> | 
  restarting varnishncsa on cp1043 | 
  [production] | 
            
  | 00:03 | 
  <maxsem> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend  'Touchhhhh' | 
  [production] | 
            
  
    | 
      
        2013-02-12
      
      §
     | 
  
    
  | 23:54 | 
  <awjrichards> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend/javascripts/specials/donateimage.js  'touch file' | 
  [production] | 
            
  | 22:58 | 
  <maxsem> | 
  Finished syncing Wikimedia installation... : | 
  [production] | 
            
  | 22:46 | 
  <notpeter> | 
  disabling innodb-flush-log-at-trx-commit=2 on db1047 w/asher's blessing. will schedule downtime to apply | 
  [production] | 
            
  | 22:38 | 
  <maxsem> | 
  Started syncing Wikimedia installation... : | 
  [production] | 
            
  | 22:04 | 
  <notpeter> | 
  creating metrics user on all s1-7 masters | 
  [production] | 
            
  | 20:25 | 
  <reedy> | 
  synchronized php-1.21wmf9/resources/mediawiki | 
  [production] | 
            
  | 20:22 | 
  <binasher> | 
  flushed mobile varnish | 
  [production] | 
            
  | 20:21 | 
  <maxsem> | 
  synchronized php-1.21wmf8/extensions/MobileFrontend | 
  [production] | 
            
  | 20:19 | 
  <maxsem> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend | 
  [production] | 
            
  | 20:06 | 
  <reedy> | 
  synchronized wmf-config/CommonSettings.php | 
  [production] | 
            
  | 20:05 | 
  <binasher> | 
  flushed mobile varnish cache �:( | 
  [production] | 
            
  | 19:59 | 
  <maxsem> | 
  synchronized php-1.21wmf8/extensions/MobileFrontend | 
  [production] | 
            
  | 19:57 | 
  <maxsem> | 
  synchronized php-1.21wmf9/extensions/MobileFrontend | 
  [production] | 
            
  | 19:11 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Disable WikibaseClient on enwiki' | 
  [production] | 
            
  | 19:01 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php  'Enable WikibaseClient on enwiki' | 
  [production] | 
            
  | 18:49 | 
  <reedy> | 
  synchronized php-1.21wmf9/extensions/Wikibase | 
  [production] | 
            
  | 18:41 | 
  <reedy> | 
  synchronized php-1.21wmf9/extensions/Wikibase | 
  [production] |