| 2012-11-08
      
      § | 
    
  | 23:56 | <logmsgbot_> | pgehres synchronized wmf-config | [production] | 
            
  | 23:51 | <K4-713> | updated payments cluster to 7d92a1a35f0 | [production] | 
            
  | 23:51 | <logmsgbot_> | pgehres synchronized php-1.21wmf3/extensions/CentralNotice/  'Updating CentralNotice to master' | [production] | 
            
  | 23:29 | <logmsgbot_> | olivneh synchronized php-1.21wmf3/extensions/E3Experiments | [production] | 
            
  | 21:18 | <cmjohnson1> | ms-be6 initial puppet run | [production] | 
            
  | 21:14 | <logmsgbot_> | asher synchronized wmf-config/CommonSettings.php  'multiwrite pcache to new memcached servers, only use redis for sessions' | [production] | 
            
  | 21:08 | <logmsgbot_> | olivneh synchronized php-1.21wmf3/extensions/EventLogging | [production] | 
            
  | 21:01 | <logmsgbot_> | olivneh synchronized php-1.21wmf3/extensions/E3Experiments | [production] | 
            
  | 21:01 | <mutante> | restarted nginx on all SSL proxies without issues now. puppet runs again and does not recreate configs for data/voyage on esams. | [production] | 
            
  | 20:55 | <mutante> | removing wikidata/voyage sites config from esams ssl hosts | [production] | 
            
  | 20:54 | <cmjohnson1> | ms-be6 another OS install | [production] | 
            
  | 20:51 | <mutante> | fixed wikipedia ssl chained cert on ssl1 (all other hosts had it recreated as expected) | [production] | 
            
  | 20:50 | <apergos> | ignore the fail event on ms-be6, this was caused manually and is a bogus warning | [production] | 
            
  | 20:31 | <logmsgbot_> | demon synchronized wmf-config/CommonSettings.php  'Enabling lucene for wikidatawiki' | [production] | 
            
  | 19:29 | <logmsgbot_> | dzahn synchronized ./wmf-config/throttle.php | [production] | 
            
  | 18:16 | <logmsgbot_> | reedy synchronized php-1.21wmf3/extensions/TimedMediaHandler | [production] | 
            
  | 18:15 | <mutante> | removing wm-nl@wikimedia.org as list admin of "press-nl" because it is an OTRS queue (per thehelpfulone) | [production] | 
            
  | 15:55 | <paravoid> | starting ms-be3 {object,container,account}-server | [production] | 
            
  | 14:42 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf3) at Thu Nov  8 14:42:45 UTC 2012 | [production] | 
            
  | 14:13 | <logmsgbot_> | LocalisationUpdate completed (1.21wmf3) at Thu Nov  8 14:13:54 UTC 2012 | [production] | 
            
  | 12:23 | <mark> | Reinstalling sq70 with Precise | [production] | 
            
  | 10:57 | <logmsgbot_> | reedy synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 10:57 | <logmsgbot_> | reedy synchronized php-1.21wmf3/extensions/ProofreadPage/ | [production] | 
            
  | 09:49 | <mark> | Killed show_bug.cgi processes on kaulen | [production] | 
            
  | 09:21 | <mark> | Power cycled cp1041 | [production] | 
            
  | 07:20 | <apergos> | restarted lucene search on search1015 | [production] | 
            
  | 06:26 | <apergos> | restarted lucene search on searchpool1016 | [production] | 
            
  | 03:03 | <logmsgbot_> | aaron synchronized php-1.21wmf3/includes/objectcache/MemcachedPeclBagOStuff.php  'deployed efda0b27befc28ec13dae23f48e8baea42f4a7f3' | [production] | 
            
  | 02:00 | <logmsgbot_> | LocalisationUpdate failed: git pull of extensions failed | [production] | 
            
  | 00:52 | <logmsgbot_> | reedy synchronized wmf-config/ | [production] | 
            
  | 00:42 | <notpeter> | repooling palladium | [production] | 
            
  | 00:40 | <mutante> | wikivoyage imports: "fr" - done | [production] | 
            
  | 00:39 | <logmsgbot_> | aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php  'removed debug logging' | [production] | 
            
  | 00:37 | <logmsgbot_> | reedy synchronized all.dblist | [production] | 
            
  | 00:35 | <logmsgbot_> | aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php | [production] | 
            
  | 00:34 | <paravoid> | temporarily stopping {account,container,object}-server on ms-be3 while it syncs up from its downtime | [production] | 
            
  | 00:34 | <paravoid> | starting memcached on virt0 | [production] | 
            
  | 00:30 | <logmsgbot_> | aaron synchronized php-1.21wmf3/extensions/SwiftCloudFiles/php-cloudfiles-wmf/cloudfiles.php | [production] | 
            
  | 00:26 | <logmsgbot_> | dzahn gracefulled all apaches | [production] | 
            
  | 00:26 | <paravoid> | powercycling ms-be3 | [production] |