| 2014-04-23
      
      § | 
    
  | 15:57 | <manybubbles> | rebuilding commons' cirrus search index | [production] | 
            
  | 15:55 | <manybubbles> | synchronized php-1.24wmf1/extensions/CirrusSearch/maintenance/updateOneSearchIndexConfig.php  'swat update to fix maintenance script' | [production] | 
            
  | 15:46 | <ottomata> | temporarily disabling puppet on analytics1003 to test some kafkatee settings | [production] | 
            
  | 15:32 | <apergos> | rebooting dataset2 hoping to detect the arrays on reboot | [production] | 
            
  | 14:40 | <akosiaris> | unexported /vol/{originals,thumbs} on nas1001-a, nas1-a | [production] | 
            
  | 14:30 | <akosiaris> | break replication for volumes originals, thumbs on nas1001-a, nas1-a | [production] | 
            
  | 14:03 | <paravoid> | adding AS path 1257 6830 (Tele2 -> UPC) to avoided paths @ cr1-esams/cr2-knams, multiple users reporting slowness issues | [production] | 
            
  | 13:52 | <akosiaris> | unmounted /vol/originals and /vol/thumbs on fenari (was /mnt/upload7, /mnt/thumbs2) see RT #7076 | [production] | 
            
  | 12:54 | <marc> | synchronized wmf-config/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 12:50 | <hashar> | Jenkins back | [production] | 
            
  | 12:47 | <hashar> | restarting jenkins | [production] | 
            
  | 12:46 | <hashar> | Jenkins: upgrading email-ext and JobConfigHistory plugins (the later now supports slaves configs!) | [production] | 
            
  | 10:35 | <hashar> | Jenkins: update lanthanum slave agent to use java7 | [production] | 
            
  | 10:32 | <hashar> | Jenkins switching integration-slave1001.eqiad.wmflabs java to use Java 7 . In https://integration.wikimedia.org/ci/computer/integration-slave1001/configure changed JavaPath to /usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java | [production] | 
            
  | 07:45 | <mutante> | nfs1 - delete some old kernels and zip mw logs last touched in 2012/13 to free some disk on / | [production] | 
            
  | 07:32 | <mutante> | nfs1 - re-enabled puppet | [production] | 
            
  | 07:12 | <mutante> | nfs2 - revoke puppet cert,salt key,stored configs | [production] | 
            
  | 06:27 | <mutante> | db48,db63 - revoke puppet cert, salt key, kill from storedconfigs | [production] | 
            
  | 03:55 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Wed Apr 23 03:55:03 UTC 2014 (duration 55m 2s) | [production] | 
            
  | 03:09 | <LocalisationUpdate> | completed (1.24wmf1) at 2014-04-23 03:08:58+00:00 | [production] | 
            
  | 02:46 | <LocalisationUpdate> | completed (1.23wmf22) at 2014-04-23 02:46:47+00:00 | [production] | 
            
  
    | 2014-04-22
      
      § | 
    
  | 23:30 | <ori> | Finished scap: I595446dc5, If2c57846f, Iaa232298e (duration: 00m 45s) | [production] | 
            
  | 23:30 | <ori> | Started scap: I595446dc5, If2c57846f, Iaa232298e | [production] | 
            
  | 23:28 | <ori> | synchronized php-1.24wmf1/extensions/EventLogging  'Update EventLogging for Iaa232298e: Set line-height for code icon on schema pages (bug 64251)' | [production] | 
            
  | 23:27 | <ori> | synchronized wmf-config/InitialiseSettings.php  'If2c57846f: Enable survey option in MediaViewer on a few more wikis' | [production] | 
            
  | 23:26 | <ori> | updated /a/common to {{Gerrit|If2c57846f}}: Enable survey option in MediaViewer on a few more wikis | [production] | 
            
  | 23:24 | <ori> | synchronized php-1.23wmf22/extensions/MultimediaViewer  'Update MultimediaViewer for I595446dc5: Add more survey languages (fr, de, pt/pr-br)' | [production] | 
            
  | 23:23 | <ori> | synchronized php-1.24wmf1/extensions/MultimediaViewer  'Update MultimediaViewer for I595446dc5: Add more survey languages (fr, de, pt/pr-br)' | [production] | 
            
  | 22:28 | <aaron> | synchronized php-1.24wmf1/maintenance/populateImageSha1.php  '32d9206d1c5b1ba39e7e47cb0a23b57d53772c1b' | [production] | 
            
  | 22:22 | <reedy> | synchronized php-1.24wmf1/extensions/TimedMediaHandler  'I7483c8b7ec75f5149998da2b530ca04' | [production] | 
            
  | 21:31 | <spage> | synchronized php-1.24wmf1/extensions/Flow/modules/discussion/styles/mixins/collapse.less  'Fix Flow collapsed topics on mw.org' | [production] | 
            
  | 21:14 | <spage> | synchronized wmf-config/InitialiseSettings.php  'Enable Flow on Compact Personal Bar talk' | [production] | 
            
  | 21:12 | <spage> | updated /a/common to {{Gerrit|I851651247}}: Non wikipedias to 1.24wmf1 | [production] | 
            
  | 20:35 | <demon> | synchronized wmf-config/CommonSettings.php  'No op in prod, disables lsearchd completely for beta' | [production] | 
            
  | 20:29 | <ottomata> | turning on varnishkafka on text varnishes | [production] | 
            
  | 20:12 | <MatmaRex> | wikibugs replaced by pywikibugs (https://github.com/valhallasw/pywikibugs) and moved to #wikimedia-dev (at last!) | [production] | 
            
  | 20:12 | <manybubbles> | rebuilding the search index for a few wikis - might cause the Elasticsearch health check to freak out because it sucks | [production] | 
            
  | 19:51 | <MatmaRex> | wikibugs is down, let's not bring it back up | [production] | 
            
  | 19:51 | <twkozlowski> | I wonder if I can log here. | [production] | 
            
  | 19:31 | <Krinkle> | Reloading Zuul to deploy config change I9c2f94b138244ab8 | [production] | 
            
  | 19:05 | <hashar> | Jenkins killed Jenkins java process on deployment-bastion.eqiad.wmflab to free up the executor and threads entirely. | [production] | 
            
  | 18:55 | <hashar> | restarted Zuul to clean up some stuck jobs from the queue | [production] | 
            
  | 18:49 | <hashar> | Jenkins deployment-bastion.eqiad.wmflab is back online: Slave successfully connected and online | [production] | 
            
  | 18:47 | <reedy> | synchronized docroot and w | [production] | 
            
  | 18:46 | <reedy> | rebuilt wikiversions.cdb and synchronized wikiversions files: non wikipedias to 1.24wmf1 | [production] | 
            
  | 18:43 | <RobH> | tridge back and accessible | [production] | 
            
  | 18:42 | <hashar> | Jenkins deposing / repooling deployment-bastion.eqiad.wmflabs slave locked up somehow, the executors are no more taken in account by Jenkins master | [production] | 
            
  | 18:33 | <RobH> | resurrecting tridge in pmtpa | [production] | 
            
  | 18:00 | <RobH> | tridge is coming dow for relocation, shouldnt disrupt anything but backups in progress | [production] | 
            
  | 17:52 | <bblack> | disable cp301[34] (mobile varnish frontends) in pybal on fenari | [production] |