| 2014-03-24
      
      § | 
    
  | 23:57 | <mutante> | ms5 - removed from icinga,puppet,storedconfigs,salt... | [production] | 
            
  | 23:51 | <ori> | Switched CentralNotice to GeoIP cookie rather than bits.wm.o/geoiplookup script tags | [production] | 
            
  | 23:43 | <awight> | update tools from de586ae4ad03be52da1bb24177ea4bf7cdbd2c94 to 2cfc441a9e5d2de3cc892d0077603579b220ac0e | [production] | 
            
  | 23:26 | <ori> | synchronized wmf-config/CommonSettings.php  'I42e9c8c97: CentralNotice: Re-set $wgCentralGeoScriptURL to false' | [production] | 
            
  | 23:25 | <ori> | updated /a/common to {{Gerrit|I42e9c8c97}}: CentralNotice: Re-set $wgCentralGeoScriptURL to false | [production] | 
            
  | 23:17 | <ori> | synchronized php-1.23wmf19/extensions/Wikidata  'I6ffb304d3: Update Wikidata' | [production] | 
            
  | 22:57 | <bd808> | Forced /srv/scap to update to c771a46 across the cluster | [production] | 
            
  | 20:07 | <subbu> | deployed Parsoid fa03dd20 with deploy repo sha e4d28e7e | [production] | 
            
  | 19:55 | <mutante> | DNS update - removing tampa search pools and searchidx2 | [production] | 
            
  | 19:36 | <mutante> | shutdown searchidx2 | [production] | 
            
  | 19:23 | <ottomata> | stopping hadoop service on analytics1020 and shutting down for move to Row D | [production] | 
            
  | 19:19 | <mutante> | searchidx2 - revoked puppet cert,remove from puppet,icinga,salt... | [production] | 
            
  | 19:02 | <ottomata> | stopping hadoop services on analytics1019 and shutting it down for move to Row D | [production] | 
            
  | 18:22 | <springle> | synchronized wmf-config/db-eqiad.php  's5 db1037 full steam' | [production] | 
            
  | 14:31 | <ottomata> | stopping hadoop services and shutting down analytics1018 | [production] | 
            
  | 03:03 | <springle> | synchronized wmf-config/db-eqiad.php  's5 repool db1037 warm up' | [production] | 
            
  | 02:41 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Mar 24 02:41:13 UTC 2014 (duration 41m 12s) | [production] | 
            
  | 02:17 | <LocalisationUpdate> | completed (1.23wmf19) at 2014-03-24 02:17:32+00:00 | [production] | 
            
  
    | 2014-03-21
      
      § | 
    
  | 22:13 | <K4-713> | updated prod civicrm to 2b635c1f5cf7 | [production] | 
            
  | 22:01 | <K4-713> | updated prod civicrm to c736116cac50121d | [production] | 
            
  | 19:23 | <mutante> | torrus was broken. going through fix per https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem | [production] | 
            
  | 18:14 | <mutante> | DNS update - adding zero.wikimedia.org | [production] | 
            
  | 18:05 | <mutante> | disabled and commented mobile2-5 in pmtpa pybal | [production] | 
            
  | 18:00 | <Krinkle> | Reloading Zuul to deploy I20b4aa9159df7 | [production] | 
            
  | 17:54 | <mutante> | same for search_pool5, and setting search_prefix (search19/20) to disabled | [production] | 
            
  | 17:52 | <mutante> | removing search_pool4 from pmtpa pybal | [production] | 
            
  | 17:51 | <mutante> | removing owa1-3 from pmtpa pybal | [production] | 
            
  | 17:42 | <mutante> | removing pmtpa https from pybal (ssl1-4) | [production] | 
            
  | 17:23 | <mutante> | remove pmtpa bits (sq67-70) from pybal | [production] | 
            
  | 17:22 | <Krinkle> | Running deleteEqualMessages.php on wuuwiki (bug 43917 comment 23) | [production] | 
            
  | 14:08 | <hashar> | Jenkins: label labs slaves with hasJenkinsDebianGlue  to build debian packages on them | [production] | 
            
  | 13:43 | <hashar> | Jenkins: installing jenkins-debian-glue and misc::package-builder on labs slaves. | [production] | 
            
  | 12:02 | <akosiaris> | upgrade jenkins-debian-glue to 0.8.1 on apt.wikimedia.org | [production] | 
            
  | 11:39 | <akosiaris> | upgraded libmemcached packages on apt.wikimedia.org to libmemcached_1.0.17-1~wmf+precise2 | [production] | 
            
  | 10:01 | <hashar> | Jenkins: deleting pmtpa labs slaves integration-slave02 and integration-slave03.  Replaced by eqiad instances integration-slave1001 and integration-slave1002. | [production] | 
            
  | 03:05 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Mar 21 03:05:27 UTC 2014 (duration 5m 26s) | [production] | 
            
  | 02:34 | <LocalisationUpdate> | completed (1.23wmf19) at 2014-03-21 02:34:39+00:00 | [production] | 
            
  | 02:12 | <LocalisationUpdate> | completed (1.23wmf18) at 2014-03-21 02:12:39+00:00 | [production] | 
            
  | 00:49 | <ori> | synchronized wmf-config  'Ib539f96eb7: Increase the network performance sampling rate for MediaViewer' | [production] |