| 
      
        2016-05-11
      
      §
     | 
  
    
  | 09:06 | 
  <ema> | 
  upgrading cp3009 to varnish 4 (T131501) | 
  [production] | 
            
  | 08:55 | 
  <ema> | 
  upgrading cp3008 to varnish 4 (T131501) | 
  [production] | 
            
  | 08:34 | 
  <mobrovac> | 
  restbase deploy end of beaaa71 | 
  [production] | 
            
  | 08:28 | 
  <godog> | 
  bootstrap restbase2008-a T132976 | 
  [production] | 
            
  | 08:24 | 
  <mobrovac> | 
  restbase deploy start of beaaa71 | 
  [production] | 
            
  | 08:18 | 
  <elukey> | 
  memcached on mc1009 restarted with chunk size growth factor 1.15 (was: 1.05) | 
  [production] | 
            
  | 08:04 | 
  <moritzm> | 
  restarting apache on palladium for openssl update | 
  [production] | 
            
  | 08:03 | 
  <elukey> | 
  puppet disabled on mc10XX hosts for https://gerrit.wikimedia.org/r/#/c/287913 | 
  [production] | 
            
  | 02:55 | 
  <l10nupdate@tin> | 
  ResourceLoader cache refresh completed at Wed May 11 02:55:55 UTC 2016 (duration 9m 47s) | 
  [production] | 
            
  | 02:46 | 
  <mwdeploy@tin> | 
  sync-l10n completed (1.28.0-wmf.1) (duration: 05m 54s) | 
  [production] | 
            
  | 02:24 | 
  <mwdeploy@tin> | 
  sync-l10n completed (1.27.0-wmf.23) (duration: 09m 39s) | 
  [production] | 
            
  
    | 
      
        2016-05-10
      
      §
     | 
  
    
  | 23:59 | 
  <maxsem@tin> | 
  Synchronized php-1.27.0-wmf.23/extensions/Kartographer/: Security patch (duration: 00m 25s) | 
  [production] | 
            
  | 23:58 | 
  <maxsem@tin> | 
  Synchronized php-1.28.0-wmf.1/extensions/Kartographer/: Security patch (duration: 00m 26s) | 
  [production] | 
            
  | 23:52 | 
  <dereckson@tin> | 
  Synchronized php-1.28.0-wmf.1/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.js: Fix 'Uncaught TypeError: this.emit is not a function' (T134794) (duration: 00m 25s) | 
  [production] | 
            
  | 23:49 | 
  <dereckson@tin> | 
  Synchronized php-1.27.0-wmf.23/extensions/VisualEditor/modules/ve-mw/init/targets/ve.init.mw.DesktopArticleTarget.js: Fix 'Uncaught TypeError: this.emit is not a function' (T134794) (duration: 00m 28s) | 
  [production] | 
            
  | 23:34 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Centralise feedback for the visual editor at the Hindi Wikipedia ([[Gerrit:287873]], T134789) (duration: 00m 25s) | 
  [production] | 
            
  | 23:31 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Enable VisualEditor in single edit mode on ja.wiki ([[Gerrit:285985]], 2/2) (duration: 00m 25s) | 
  [production] | 
            
  | 23:30 | 
  <dereckson@tin> | 
  Synchronized dblists/visualeditor-default.dblist: Enable VisualEditor in single edit mode on ja.wiki ([[Gerrit:285985]], 1/2) (duration: 00m 25s) | 
  [production] | 
            
  | 23:21 | 
  <robh> | 
  disabling ulsfo via dns for onsite work tomorrow per T134831 | 
  [production] | 
            
  | 23:18 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Configure cross-wiki uploads from test2wiki to testwiki ([[Gerrit:285708]], 2/2) (duration: 00m 27s) | 
  [production] | 
            
  | 23:17 | 
  <dereckson@tin> | 
  Synchronized wmf-config/filebackend-production.php: Configure cross-wiki uploads from test2wiki to testwiki ([[Gerrit:285708]], 1/2) (duration: 00m 27s) | 
  [production] | 
            
  | 23:05 | 
  <dereckson@tin> | 
  Synchronized wmf-config/CommonSettings.php: Undeploy UploadWizard from test2wiki ([[Gerrit:287944]], 2/2) (duration: 00m 27s) | 
  [production] | 
            
  | 23:04 | 
  <dereckson@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: Undeploy UploadWizard from test2wiki ([[Gerrit:287944]], 1/2) (duration: 00m 30s) | 
  [production] | 
            
  | 22:28 | 
  <yurik> | 
  graphoid was restarted on all scb servers with the new caching configuration. T134542 | 
  [production] | 
            
  | 22:08 | 
  <mutante> | 
  ocg1003 - papaul fixed the install issue  | 
  [production] | 
            
  | 22:08 | 
  <mutante> | 
  ocg1003 - revoked old puppet cert, signed new cert, re-adding after reinstall | 
  [production] | 
            
  | 21:07 | 
  <gehel> | 
  merging and applying configuration for new maps servers | 
  [production] | 
            
  | 20:24 | 
  <mutante> | 
  scheduled icinga downtime for ocg1003 and all services on it, rebooting to PXE (T84723) | 
  [production] | 
            
  | 20:01 | 
  <bblack> | 
  re-enabling puppet on caches | 
  [production] | 
            
  | 19:53 | 
  <demon@tin> | 
  Finished scap: group0 wikis to 1.28.0-wmf.1 (duration: 26m 49s) | 
  [production] | 
            
  | 19:26 | 
  <demon@tin> | 
  Started scap: group0 wikis to 1.28.0-wmf.1 | 
  [production] | 
            
  | 19:20 | 
  <ottomata> | 
  upgraded kafka1022 to confluent kafka 0.9.0.1 | 
  [production] | 
            
  | 19:11 | 
  <ottomata> | 
  reenabling camus and puppet on analytics1027 | 
  [production] | 
            
  | 18:38 | 
  <mutante> | 
  deleted /tmp/make-wmf-branch on tin by request | 
  [production] | 
            
  | 18:20 | 
  <yurik> | 
  finished graphoid deployment & restart.  T134575 | 
  [production] | 
            
  | 18:18 | 
  <bblack> | 
  disabling puppet on caches for nginx change observe/deploy... | 
  [production] | 
            
  | 18:10 | 
  <jynus> | 
  testing GTID replication on es2019 T133385 T130702  | 
  [production] | 
            
  | 18:01 | 
  <cscott> | 
  OCG: script reported "Cleared 0 (of 363141 total) entries from cache in 56.894 seconds" (T120079) | 
  [production] | 
            
  | 18:01 | 
  <ottomata> | 
  stopping kafka on kafka1022 to upgrade to 0.9 | 
  [production] | 
            
  | 18:00 | 
  <cscott> | 
  OCG: clearing cache for ocg1003.eqiad.wmnet and ocg1003 (T120079) | 
  [production] | 
            
  | 17:57 | 
  <ottomata> | 
  stopping camus and puppet on analytics1027 during upgrade of one kafka broker | 
  [production] | 
            
  | 17:56 | 
  <yurik> | 
  about to deploy graphoid | 
  [production] | 
            
  | 17:41 | 
  <cscott> | 
  updated OCG to version b0c57a1c6890e9fa1f2c3743fc14cb6a7f244fc3 (T120079) | 
  [production] | 
            
  | 17:38 | 
  <cscott> | 
  starting OCG deploy | 
  [production] | 
            
  | 16:40 | 
  <ema> | 
  repooling cp3007 running varnish 4 | 
  [production] | 
            
  | 16:04 | 
  <godog> | 
  nodetool cleanup on restbase2005 T132976 | 
  [production] | 
            
  | 16:03 | 
  <robh> | 
  i fubar'd sinistra's grub, it'll be offline for a bit while longer. | 
  [production] | 
            
  | 15:52 | 
  <csteipp> | 
  deployed patch for T134863 | 
  [production] | 
            
  | 15:48 | 
  <godog> | 
  collect mysqld metrics with prometheus-metrics-collector 0.8.1 on db2070 for 24h T128185 | 
  [production] | 
            
  | 15:35 | 
  <thcipriani@tin> | 
  Synchronized wmf-config/CommonSettings.php: SWAT: Configure $wgCheckUserCAMultiLock for CentralAuth wikis [[gerrit:286927]] (duration: 00m 26s) | 
  [production] |