| 2014-04-14
      
      § | 
    
  | 15:09 | <manybubbles> | synchronized php-1.23wmf21/extensions/CirrusSearch/  'SWAT deploy to improve performance' | [production] | 
            
  | 14:48 | <paravoid> | upgrading all snapshot* hosts | [production] | 
            
  | 14:38 | <paravoid> | upgrading all packages & staggered restart of all of swift (ms-fe/ms-be) | [production] | 
            
  | 13:22 | <reedy> | synchronized php-1.23wmf22/includes/api/ApiFeedRecentChanges.php  'I268d0a53067738ba96bee74c593358b0b28cc083' | [production] | 
            
  | 13:22 | <reedy> | synchronized php-1.23wmf21/includes/api/ApiFeedRecentChanges.php  'I268d0a53067738ba96bee74c593358b0b28cc083' | [production] | 
            
  | 13:15 | <paravoid> | staggered upgrades for all pending updates on all mw* boxes & restarting apaches/other core services | [production] | 
            
  | 11:08 | <mutante> | brewster - shut down | [production] | 
            
  | 10:49 | <reedy> | synchronized wmf-config/interwiki.cdb  'Updating interwiki cache' | [production] | 
            
  | 10:05 | <apergos> | had to toss extensions/Elastica on virt1000 and run git submodule update --init --recursive     seems to be working now | [production] | 
            
  | 09:26 | <mutante> | deleting huge pybal log on lvs3001 | [production] | 
            
  | 09:01 | <mutante> | brewster - stop lighttpd,bacula-fd,haproxy,dhcp3-server,rsync,nrpe,salt | [production] | 
            
  | 07:54 | <mutante> | brewster - disabling puppet agent, removed from site.pp, revoke puppet cert | [production] | 
            
  | 03:23 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Mon Apr 14 03:22:58 UTC 2014 (duration 22m 57s) | [production] | 
            
  | 02:42 | <LocalisationUpdate> | completed (1.23wmf22) at 2014-04-14 02:42:05+00:00 | [production] | 
            
  | 02:23 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-14 02:22:58+00:00 | [production] | 
            
  
    | 2014-04-11
      
      § | 
    
  | 23:55 | <RoanKattouw> | Restarting stuck Jenkins | [production] | 
            
  | 23:35 | <K4-713> | synchronized payments to af35b7b175bbe23 | [production] | 
            
  | 23:25 | <K4-713> | synchronized payments to b3211631dada043 | [production] | 
            
  | 19:50 | <ottomata> | upgraded wikitech to MediaWiki 1.23wmf22, applied security patch | [production] | 
            
  | 18:19 | <ottomata> | rebooting elastic1003 | [production] | 
            
  | 18:14 | <Krinkle> | git-deploy: Deploying integration/slave-scripts I38b90e8c08d7cb | [production] | 
            
  | 18:08 | <Krinkle> | git-deploy: Deploying integration/slave-scripts I04d8e308daedb3ccb8 | [production] | 
            
  | 17:41 | <Krinkle> | git-deploy: Deploying integration/slave-scripts 'Ia9ee438fa2675170' | [production] | 
            
  | 14:27 | <ottomata> | reinstalling elastic1005 | [production] | 
            
  | 04:33 | <LocalisationUpdate> | ResourceLoader cache refresh completed at Fri Apr 11 04:33:40 UTC 2014 (duration 33m 39s) | [production] | 
            
  | 03:47 | <LocalisationUpdate> | completed (1.23wmf22) at 2014-04-11 03:47:01+00:00 | [production] | 
            
  | 02:41 | <LocalisationUpdate> | completed (1.23wmf21) at 2014-04-11 02:41:33+00:00 | [production] | 
            
  | 02:29 | <ori_> | graphite: carbon instance 'f' saturates a cpu core. it's the instance that mediawiki profiling data gets hashed to. collector should probably emit to statsd and have statsd compute per-minute rollups | [production] | 
            
  | 00:06 | <marktraceur> | leaving MultimediaViewer slightly broken on enwiki based on the fact that logged-in users seem mostly unaffected and other wikis aren't seeing issues, will investigate more tomorrow and fix on Monday | [production] | 
            
  
    | 2014-04-10
      
      § | 
    
  | 23:54 | <bd808> | Enabled beta update Jenkins job (https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/) | [production] | 
            
  | 23:37 | <mwalker> | Finished scap: Attempting to regenerate i18n keys for multimediaviewer (duration: 03m 33s) | [production] | 
            
  | 23:34 | <mwalker> | Started scap: Attempting to regenerate i18n keys for multimediaviewer | [production] | 
            
  | 23:16 | <mwalker> | synchronized wmf-config/filebackend.php | [production] | 
            
  | 23:09 | <mwalker> | synchronized wmf-config/InitialiseSettings.php  'touched to see if that pushes changes to FileBackend.php' | [production] | 
            
  | 23:03 | <mwalker> | sync-common for {{gerrit|125340}} and {{gerrit|125335}} | [production] | 
            
  | 22:53 | <krinkle> | synchronized php-1.23wmf21/extensions/VisualEditor/modules/ve-mw/ui/tools/  'touch *.js' | [production] | 
            
  | 22:35 | <krinkle> | synchronized php-1.23wmf21/extensions/VisualEditor/modules/ve-mw/ui/tools/ve.ui.MWReferenceDialogTool.js  'touch' | [production] | 
            
  | 22:12 | <krinkle> | synchronized php-1.23wmf21/extensions/VisualEditor/lib/ve/modules/ve/ui/ve.ui.Toolbar.js  'touch' | [production] | 
            
  | 22:10 | <krinkle> | synchronized php-1.23wmf21/extensions/VisualEditor/lib/ve/lib/oojs-ui/oojs-ui.js  'touch' | [production] | 
            
  | 22:10 | <krinkle> | synchronized php-1.23wmf21/resources/startup.js  'touch' | [production] | 
            
  | 22:10 | <krinkle> | synchronized php-1.23wmf21/resources/oojs-ui/oojs-ui.js  'touch' | [production] | 
            
  | 21:50 | <Krinkle> | VisualEditor throws uncaught error on load for 1.23wmf21 wikis (bug 63791) | [production] | 
            
  | 21:15 | <bd808> | Disabled beta update Jenkins job (https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/) so that scap testing can happen in beta. | [production] |