| 2014-03-21
      
      § | 
    
  | 22:13 | <K4-713> | updated prod civicrm to 2b635c1f5cf7 | [production] | 
            
  | 22:01 | <K4-713> | updated prod civicrm to c736116cac50121d | [production] | 
            
  | 19:23 | <mutante> | torrus was broken. going through fix per https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem | [production] | 
            
  | 18:14 | <mutante> | DNS update - adding zero.wikimedia.org | [production] | 
            
  | 18:05 | <mutante> | disabled and commented mobile2-5 in pmtpa pybal | [production] | 
            
  | 18:00 | <Krinkle> | Reloading Zuul to deploy I20b4aa9159df7 | [production] | 
            
  | 17:54 | <mutante> | same for search_pool5, and setting search_prefix (search19/20) to disabled | [production] | 
            
  | 17:52 | <mutante> | removing search_pool4 from pmtpa pybal | [production] | 
            
  | 17:51 | <mutante> | removing owa1-3 from pmtpa pybal | [production] | 
            
  | 17:42 | <mutante> | removing pmtpa https from pybal (ssl1-4) | [production] | 
            
  | 17:23 | <mutante> | remove pmtpa bits (sq67-70) from pybal | [production] | 
            
  | 17:22 | <Krinkle> | Running deleteEqualMessages.php on wuuwiki (bug 43917 comment 23) | [production] | 
            
  | 14:08 | <hashar> | Jenkins: label labs slaves with hasJenkinsDebianGlue  to build debian packages on them | [production] | 
            
  | 13:43 | <hashar> | Jenkins: installing jenkins-debian-glue and misc::package-builder on labs slaves. | [production] | 
            
  | 12:02 | <akosiaris> | upgrade jenkins-debian-glue to 0.8.1 on apt.wikimedia.org | [production] | 
            
  | 11:39 | <akosiaris> | upgraded libmemcached packages on apt.wikimedia.org to libmemcached_1.0.17-1~wmf+precise2 | [production] | 
            
  | 10:01 | <hashar> | Jenkins: deleting pmtpa labs slaves integration-slave02 and integration-slave03.  Replaced by eqiad instances integration-slave1001 and integration-slave1002. | [production] | 
            
  | 03:05 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Mar 21 03:05:27 UTC 2014 (duration 5m 26s) | [production] | 
            
  | 02:34 | <LocalisationUpdate> | completed (1.23wmf19) at 2014-03-21 02:34:39+00:00 | [production] | 
            
  | 02:12 | <LocalisationUpdate> | completed (1.23wmf18) at 2014-03-21 02:12:39+00:00 | [production] | 
            
  | 00:49 | <ori> | synchronized wmf-config  'Ib539f96eb7: Increase the network performance sampling rate for MediaViewer' | [production] | 
            
  | 00:48 | <ori> | updated /a/common to {{Gerrit|Ib0eb802c4}}: Fix typo in I86f5493d0 | [production] | 
            
  | 00:38 | <hoo> | synchronized wmf-config/  'Fix typo  <> udp, also Icdb5425 and I04e5f7f which weren't synced but look harmless' | [production] | 
            
  
    | 2014-03-20
      
      § | 
    
  | 23:38 | <catrope> | synchronized php-1.23wmf18/resources/mediawiki/mediawiki.inspect.js | [production] | 
            
  | 23:22 | <catrope> | synchronized wmf-config/CommonSettings.php | [production] | 
            
  | 23:22 | <catrope> | synchronized wmf-config/InitialiseSettings.php | [production] | 
            
  | 23:22 | <catrope> | synchronized docroot/noc/createTxtFileSymlinks.sh | [production] | 
            
  | 23:22 | <catrope> | updated /a/common to {{Gerrit|Ia08c65d40}}: Enable Flow on Hovercards Beta Features | [production] | 
            
  | 21:43 | <ori> | synchronized wmf-config/InitialiseSettings.php  'If51eda243: Follow up Id6222f4db to amend sort order in feed URL' | [production] | 
            
  | 21:43 | <ori> | updated /a/common to {{Gerrit|If51eda243}}: Follow up Id6222f4db to amend sort order in feed URL | [production] | 
            
  | 21:20 | <ori> | synchronized wmf-config/InitialiseSettings.php  'Id6222f4d: Add RSS of Bugzilla query of open HHVM bugs to mediawikiwiki's whitelist' | [production] | 
            
  | 21:20 | <ori> | updated /a/common to {{Gerrit|Id6222f4db}}: Add RSS of Bugzilla query of open HHVM bugs to mediawikiwiki's whitelist | [production] | 
            
  | 21:06 | <reedy> | synchronized docroot and w | [production] | 
            
  | 21:03 | <reedy> | updated /a/common to {{Gerrit|Iaa99d2162}}: Add Wikibase repoSiteName setting for client | [production] | 
            
  | 20:56 | <bd808> | Updated scholarships.wikimedia.org to cb2ef4c (fix for bug 62464) | [production] | 
            
  | 20:14 | <mutante> | DNS update - remove ssl1-4 | [production] | 
            
  | 20:08 | <mutante> | DNS update - remove sq67-70, former varnish testing | [production] | 
            
  | 19:35 | <akosiaris> | created a 50G LV for /var/log on zirconium, stopped all services, moved data to it, mounted it and restarted all services | [production] | 
            
  | 19:29 | <reedy> | synchronized wmf-config/  'Wikibase config updates' | [production] | 
            
  | 19:23 | <reedy> | Finished scap: Rebuild 1.23wmf19 l10n cache for wikibase (duration: 12m 01s) | [production] | 
            
  | 19:10 | <reedy> | Started scap: Rebuild 1.23wmf19 l10n cache for wikibase | [production] | 
            
  | 19:08 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.23wmf19 | [production] | 
            
  | 19:02 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.23wmf18 | [production] | 
            
  | 19:00 | <mutante> | disk full on zirconium - gzipping some etherpadlite.sql dump i found | [production] | 
            
  | 17:41 | <reedy> | synchronized php-1.23wmf19  'Update Wikidata and WikimediaMessages' | [production] | 
            
  | 17:06 | <Krinkle> | Reloading Zuul to deploy Ie800ed90b51c47d5a1 | [production] | 
            
  | 16:58 | <mutante> | repooling mw1163 (it's back in dsh as well) | [production] | 
            
  | 16:38 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: testwiki back to 1.23wmf18 till window | [production] | 
            
  | 16:05 | <bd808> | Ran /usr/local/bin/sync-common && /usr/local/bin/scap-rebuild-cdbs on mw1163. Should not repool until it's back in the dsh group. Should me manually synced just before repooling. | [production] |