| 2013-05-06
      
      § | 
    
  | 20:14 | <mutante> | DNS update - sync with ns2 | [production] | 
            
  | 20:04 | <mutante> | restarting parsoid on wtp1001 | [production] | 
            
  | 20:02 | <mutante> | restarting pdns on ns0 | [production] | 
            
  | 20:00 | <mutante> | killing parsoid server.js on wtp1001 | [production] | 
            
  | 19:59 | <aaron> | synchronized multiversion/MWMultiVersion.php  'f257ddac39194f8bfcfd145104999fdba83d33f5' | [production] | 
            
  | 19:58 | <mutante> | DNS update - switch all blog cnames over to holmium | [production] | 
            
  | 19:29 | <reedy> | synchronized php-1.22wmf3/extensions/ZeroRatedMobileAccess/ | [production] | 
            
  | 19:24 | <LeslieCarr> | moved gateway from csw1-esams to cr1-esams | [production] | 
            
  | 19:18 | <Krinkle> | Reloading Zuul to deploy I259585e78ee | [production] | 
            
  | 19:17 | <LeslieCarr> | rebooting ns2 | [production] | 
            
  | 19:15 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 19:13 | <binasher> | rebuilt db1016 from hotbackup of db1001; pmtpa side of m1 needs to be rebuilt as well | [production] | 
            
  | 18:41 | <RobH> | ns2/nescio appears offline, investigating | [production] | 
            
  | 18:37 | <RobH> | ns2 appears offline | [production] | 
            
  | 18:36 | <RobH> | authdns-update crashed on ns2, rerunning | [production] | 
            
  | 18:33 | <RobH> | holmium | [production] | 
            
  | 18:33 | <RobH> | authdns-update for new server homium | [production] | 
            
  | 18:07 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: enwiki to 1.22wmf3 | [production] | 
            
  | 17:17 | <LeslieCarr> | marmontel's interface is now in the sandbox vlan | [production] | 
            
  | 17:15 | <LeslieCarr> | turned off marmontel's network port | [production] | 
            
  | 16:11 | <reedy> | synchronized docroot | [production] | 
            
  | 13:54 | <hashar> | gallium: installed manually libcidr0-dev libanon0-dev . Puppet change is {{gerrit|62434}} | [production] | 
            
  | 09:51 | <paravoid> | upgrading Ganglia Web to 3.5.7 | [production] | 
            
  | 08:25 | <hashar> | Zuul upgrading to upstream version 7191ee8 + 1 wmf hack. | [production] | 
            
  | 06:45 | <Nemo_bis> | Translate search on vanadium keeps being broken https://toolserver.org/~nemobis/tmp/SearchTranslations.log | [production] | 
            
  | 06:14 | <paravoid> | pushing new swift rings: ms-be1 weight 50->0, ms-be2 33->75 | [production] | 
            
  | 02:18 | <paravoid> | restarting gerrit | [production] | 
            
  | 02:18 | <LocalisationUpdate> | failed: git pull of extensions failed | [production] | 
            
  
    | 2013-05-04
      
      § | 
    
  | 22:41 | <reedy> | synchronized wmf-config/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 21:44 | <Reedy> | Manually force ran TorBlock/loadExitNodes.php | [production] | 
            
  | 21:42 | <reedy> | synchronized php-1.22wmf3/extensions/TorBlock/ | [production] | 
            
  | 16:02 | <reedy> | synchronized wmf-config/ | [production] | 
            
  | 16:02 | <reedy> | synchronized docroot/bits/WikipediaMobileFirefoxOS/ | [production] | 
            
  | 04:36 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Sat May  4 04:36:09 UTC 2013 | [production] | 
            
  | 02:20 | <LocalisationUpdate> | completed (1.22wmf2) at Sat May  4 02:20:30 UTC 2013 | [production] | 
            
  | 02:12 | <LocalisationUpdate> | completed (1.22wmf3) at Sat May  4 02:12:01 UTC 2013 | [production] | 
            
  | 01:17 | <Krinkle> | binasher restarted gerrit | [production] | 
            
  | 00:48 | <Krinkle> | as of an hour ago Gerrit is completely unresponsive. Filed details at https://bugzilla.wikimedia.org/show_bug.cgi?id=48061 | [production] |