| 
      
        2013-04-04
      
      §
     | 
  
    
  | 19:33 | 
  <maxsem> | 
  synchronized php-1.21wmf12/extensions/MobileFrontend  'https://gerrit.wikimedia.org/r/#/c/57525/' | 
  [production] | 
            
  | 19:29 | 
  <maxsem> | 
  synchronized php-1.22wmf1/extensions/MobileFrontend  'https://gerrit.wikimedia.org/r/#/c/57525/' | 
  [production] | 
            
  | 19:19 | 
  <binasher> | 
  enabled 1:100 full query logging on db1042/1043, disabled puppet [planning to revert in 4-8 hours] | 
  [production] | 
            
  | 19:09 | 
  <maxsem> | 
  synchronized wmf-config/InitialiseSettings.php  'https://gerrit.wikimedia.org/r/57528' | 
  [production] | 
            
  | 19:00 | 
  <binasher> | 
  resuming iwlinks migrations on s3 | 
  [production] | 
            
  | 17:31 | 
  <mlitn> | 
  synchronized php-1.22wmf1/extensions/ArticleFeedbackv5  'Update ArticleFeedbackv5 to master' | 
  [production] | 
            
  | 17:30 | 
  <mlitn> | 
  synchronized php-1.21wmf12/extensions/ArticleFeedbackv5  'Update ArticleFeedbackv5 to master' | 
  [production] | 
            
  | 17:27 | 
  <mlitn> | 
  synchronized wmf-config/InitialiseSettings.php  'Updating ArticleFeedbackv5 frwiki config' | 
  [production] | 
            
  | 16:15 | 
  <paravoid> | 
  upgrading image & video scalers for libav | 
  [production] | 
            
  | 15:54 | 
  <ottomata> | 
  now generating webstatscollector dumps on gadolinium.  snapshot1 syncs dumps from there over to dataset2 for dumps.wikimedia.org | 
  [production] | 
            
  | 15:38 | 
  <K4-713> | 
  adjusted anti-fraud rules on the payments cluster | 
  [production] | 
            
  | 13:26 | 
  <^demon> | 
  running jgit gc on all repos | 
  [production] | 
            
  | 05:42 | 
  <Ryan_Lane> | 
  clearing squid logs and restarting squid on brewster | 
  [production] | 
            
  | 04:16 | 
  <Ryan_Lane> | 
  opendj upgrade on virt1000 complete | 
  [production] | 
            
  | 03:56 | 
  <Ryan_Lane> | 
  upgrading opendj on virt1000 | 
  [production] | 
            
  | 02:21 | 
  <LocalisationUpdate> | 
  completed (1.21wmf12) at Thu Apr  4 02:21:01 UTC 2013 | 
  [production] | 
            
  | 02:13 | 
  <LocalisationUpdate> | 
  completed (1.22wmf1) at Thu Apr  4 02:13:31 UTC 2013 | 
  [production] | 
            
  
    | 
      
        2013-04-03
      
      §
     | 
  
    
  | 23:18 | 
  <mwalker> | 
  Updating CentralNotice schema on testwiki & metawiki with patch-centralnotice-2_3.sql | 
  [production] | 
            
  | 22:45 | 
  <reedy> | 
  synchronized wmf-config/InitialiseSettings.php | 
  [production] | 
            
  | 21:44 | 
  <binasher> | 
  started iwlinks index migrations on all wikis [gerrit 43389] | 
  [production] | 
            
  | 21:32 | 
  <cmjohnson1> | 
  Running DNS update | 
  [production] | 
            
  | 20:34 | 
  <ottomata> | 
  udpated webstatscollector package in apt repo to 0.1-3 | 
  [production] | 
            
  | 18:54 | 
  <mutante> | 
  DNS update - also adding softwarewikipedia.org | 
  [production] | 
            
  | 18:49 | 
  <RoanKattouw> | 
  Removed caesium and xenon from /home/wikipedia/common/docroot/noc/pybal/eqiad/parsoid | 
  [production] | 
            
  | 18:42 | 
  <mutante> | 
  restarting pdns on ns1 | 
  [production] | 
            
  | 18:42 | 
  <mutante> | 
  DNS update - adding softwarewikipedia.com for RT-4355 | 
  [production] | 
            
  | 18:41 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikiquote and wikibooks to 1.22wmf1 | 
  [production] | 
            
  | 18:39 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wiktionary to 1.22wmf1 | 
  [production] | 
            
  | 18:35 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikinews and wikisource to 1.22wmf1 | 
  [production] | 
            
  | 18:31 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: wikiversity and wikivoyage to 1.22wmf1 | 
  [production] | 
            
  | 18:26 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: special, wikimania and wikimedia wikis to 1.22wmf1 | 
  [production] | 
            
  | 18:07 | 
  <reedy> | 
  rebuilt wikiversions.cdb and synchronized wikiversions files: private, closed and fishbowl to 1.22wmf1 | 
  [production] | 
            
  | 17:14 | 
  <aaron> | 
  synchronized php-1.22wmf1/includes/objectcache/SqlBagOStuff.php  'deployed b61053ca4b554f6bd18fb6408967839cdb5ccde2' | 
  [production] | 
            
  | 17:12 | 
  <aaron> | 
  synchronized php-1.21wmf12/includes/objectcache/SqlBagOStuff.php  'deployed 61587acc64cb62400ff7978271c54e8bd8b1f02d' | 
  [production] | 
            
  | 16:54 | 
  <reedy> | 
  synchronized php-1.21wmf12/includes/Collation.php | 
  [production] | 
            
  | 16:34 | 
  <cmjohnson1> | 
  authdns update | 
  [production] | 
            
  | 14:21 | 
  <cmjohnson> | 
  synchronized wmf-config/db-eqiad.php  'setting weight on db1028 to 400' | 
  [production] | 
            
  | 13:15 | 
  <mark> | 
  Stopped and started MySQL on pc1003 after finding mysql deadlocked | 
  [production] | 
            
  | 13:10 | 
  <reedy> | 
  synchronized wmf-config/ | 
  [production] | 
            
  | 12:19 | 
  <mark> | 
  Rebooting cp3003 for RAID reconfiguration | 
  [production] | 
            
  | 10:43 | 
  <mark> | 
  Deactivated AS6908 peering on cr2-knams | 
  [production] | 
            
  | 06:09 | 
  <^demon> | 
  gerrit: finished doing jgit gc on mediawiki/core. Repo size 3G -> 323M. Fresh clone time to <5m to localhost, <1.5m to other hosts inside wmf. I rock. Backup's in /home/demon/core.git in case something goes wrong. Bed time. | 
  [production] | 
            
  | 03:05 | 
  <LeslieCarr> | 
  the final upload varnish is on 2gig instead of 1gig ! win! | 
  [production] | 
            
  | 02:31 | 
  <LocalisationUpdate> | 
  completed (1.22wmf1) at Wed Apr  3 02:31:44 UTC 2013 | 
  [production] | 
            
  | 02:19 | 
  <LocalisationUpdate> | 
  completed (1.21wmf12) at Wed Apr  3 02:19:30 UTC 2013 | 
  [production] | 
            
  | 01:05 | 
  <LeslieCarr> | 
  applying a big change to varnish interface groups - risk higher than normal | 
  [production] | 
            
  | 00:05 | 
  <binasher> | 
  removed sda3/varnish.persist on cp1021, restarted varnish | 
  [production] |