| 
      
        2018-03-19
      
      ยง
     | 
  
    
  | 14:42 | 
  <akosiaris> | 
  T184919 pool all kubernetes for service mathoid. | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes1004.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes1002.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes2004.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes2003.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:40 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes2002.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:34 | 
  <elukey> | 
  reboot kafka1002 (eventbus/jobqueue) for kernel upgrades | 
  [production] | 
            
  | 14:28 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes2001.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:28 | 
  <akosiaris@puppetmaster1001> | 
  conftool action : set/pooled=yes; selector: kubernetes1001.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) | 
  [production] | 
            
  | 14:18 | 
  <ema> | 
  cp3040: discard old VCL T189892 | 
  [production] | 
            
  | 14:09 | 
  <moritzm> | 
  restarting apache on contint1001 to pick up curl security update | 
  [production] | 
            
  | 13:48 | 
  <anomie> | 
  Cleaning up orphaned image_comment_temp rows on all wikis for T189985 | 
  [production] | 
            
  | 13:44 | 
  <anomie@tin> | 
  Synchronized php-1.31.0-wmf.25/includes/filerepo/file/LocalFile.php: Applying fix for T189985 (duration: 00m 58s) | 
  [production] | 
            
  | 13:22 | 
  <zeljkof> | 
  EU SWAT finished | 
  [production] | 
            
  | 13:20 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:418700|Revert "Restrict FlaggedRevs to only operated on NS_MAIN on arwiki" (T148603 T189224)]] (duration: 00m 58s) | 
  [production] | 
            
  | 13:10 | 
  <zfilipin@tin> | 
  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:419535|Enable rollbacker user right at arwikiquote (T189732)]] (duration: 00m 57s) | 
  [production] | 
            
  | 13:09 | 
  <moritzm> | 
  reimage mw1294-1296 as video scalers | 
  [production] | 
            
  | 13:02 | 
  <arturo> | 
  labtestcontrol2001: set GRUB_TIMEOUT=30 in /etc/default/grub, the previous value (10) wasn't enough to display the menu via mgmt | 
  [production] | 
            
  | 12:52 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 (duration: 00m 57s) | 
  [production] | 
            
  | 12:40 | 
  <arturo> | 
  T189722 reboot labtestcontrol2001 | 
  [production] | 
            
  | 12:37 | 
  <moritzm> | 
  installing curl security updates | 
  [production] | 
            
  | 12:16 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Restore es1016 original weight after kernel, mariadb and socket location upgrade (duration: 00m 58s) | 
  [production] | 
            
  | 11:55 | 
  <_joe_> | 
  stopping hhvm on terbium for a test. | 
  [production] | 
            
  | 11:44 | 
  <moritzm> | 
  reimage mw1293 as video scaler | 
  [production] | 
            
  | 11:29 | 
  <godog> | 
  point codfw puppet to puppetmaster2001 | 
  [production] | 
            
  | 11:27 | 
  <hashar@tin> | 
  Synchronized docroot/wwwportal/portal: (no justification provided) (duration: 00m 57s) | 
  [production] | 
            
  | 11:17 | 
  <ema> | 
  cache_misc@esams: upgrade to varnish 5.1.3-1wm4 | 
  [production] | 
            
  | 11:14 | 
  <jdrewniak@tin> | 
  Synchronized portals: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) | 
  [production] | 
            
  | 11:13 | 
  <jdrewniak@tin> | 
  Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) | 
  [production] | 
            
  | 11:06 | 
  <moritzm> | 
  uploaded openjdk-8 8u162-b12-1~bpo8+1 for jessie-wikimedia to apt.wikimedia.org | 
  [production] | 
            
  | 10:58 | 
  <godog> | 
  point eqsin puppet to puppetmaster2001 | 
  [production] | 
            
  | 10:53 | 
  <moritzm> | 
  restarting jenkins on releases1001 to pick up Java security update | 
  [production] | 
            
  | 10:47 | 
  <godog> | 
  point ulsfo puppet to puppetmaster2001 | 
  [production] | 
            
  | 10:37 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Repool db1065 - T183469 (duration: 00m 58s) | 
  [production] | 
            
  | 10:25 | 
  <marostegui> | 
  Remove db1009 from tendril - T189216 | 
  [production] | 
            
  | 10:14 | 
  <ema> | 
  cp3008: upgrade to varnish 5.1.3-1wm4 | 
  [production] | 
            
  | 09:55 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-codfw.php: Remove db1009 from config - T189216 (duration: 00m 57s) | 
  [production] | 
            
  | 09:54 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Remove db1009 from config - T189216 (duration: 00m 58s) | 
  [production] | 
            
  | 09:45 | 
  <marostegui> | 
  Stop MySQL on db1009 - T189216 | 
  [production] | 
            
  | 09:37 | 
  <elukey> | 
  restart hadoop daemons on analytics1070 for openjdk upgrades (canary) | 
  [production] | 
            
  | 09:27 | 
  <godog> | 
  reimage puppetmaster2001 with stretch - T184562 | 
  [production] | 
            
  | 09:22 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Slowly repool es1016 after kernel, mariadb and socket location upgrade (duration: 00m 58s) | 
  [production] | 
            
  | 09:10 | 
  <godog> | 
  depool codfw puppetmaster - T184562 | 
  [production] | 
            
  | 09:08 | 
  <marostegui> | 
  Stop MySQL on es1016 for kernel, mariadb and socket location upgrade | 
  [production] | 
            
  | 09:07 | 
  <marostegui@tin> | 
  Synchronized wmf-config/db-eqiad.php: Depool es1016 for kernel, mariadb and socket location upgrade (duration: 00m 58s) | 
  [production] | 
            
  | 08:57 | 
  <moritzm> | 
  installing openjdk-8 security updates | 
  [production] | 
            
  | 08:41 | 
  <elukey> | 
  reboot thorium for kernel security upgrades (hosts all analytics websites, they will go down temporary) | 
  [production] | 
            
  | 08:26 | 
  <moritzm> | 
  installing libvorbis security updates | 
  [production] | 
            
  | 08:22 | 
  <elukey> | 
  revert previous state on aqs1004, the new pkg might need some more work - T189529 | 
  [production] |