| 2017-09-27
      
      ยง | 
    
  | 15:58 | <ema@neodymium> | conftool action : set/pooled=yes; selector: name=cp4022.ulsfo.wmnet | [production] | 
            
  | 15:54 | <marostegui@tin> | Synchronized wmf-config/db-eqiad.php: Pool db1103 with low weight - T172679 (duration: 00m 47s) | [production] | 
            
  | 15:51 | <ema> | lvs4002: upgrade pybal to 1.14.0 | [production] | 
            
  | 15:48 | <ema> | lvs4004: upgrade pybal to 1.14.0 | [production] | 
            
  | 15:28 | <_joe_> | uploaded prometheus-statsd-exporter to stretch-wikimedia T175539 | [production] | 
            
  | 15:24 | <bblack> | rebooting cp402[2356] (bnx2x oops) | [production] | 
            
  | 15:15 | <moritzm> | revoking salt certs for WMCS | [production] | 
            
  | 15:12 | <mlitn@tin> | Synchronized wmf-config/CommonSettings-labs.php: Remove 3D beta config (duration: 00m 47s) | [production] | 
            
  | 15:11 | <mlitn@tin> | Synchronized wmf-config/InitialiseSettings-labs.php: Remove 3D beta config (duration: 00m 48s) | [production] | 
            
  | 15:10 | <mlitn@tin> | Synchronized wmf-config/CommonSettings.php: Load 3D extension (duration: 00m 49s) | [production] | 
            
  | 15:09 | <mlitn@tin> | Synchronized wmf-config/InitialiseSettings.php: Config 3D to be loaded on test, test2 (duration: 00m 48s) | [production] | 
            
  | 15:00 | <mlitn@tin> | Finished scap: Enable 3D extension (duration: 37m 09s) | [production] | 
            
  | 14:58 | <ema> | lvs1007: upgrade pybal to 1.14.0 | [production] | 
            
  | 14:45 | <elukey> | rolling restart of all the Yarn nodemanager daemons on analytics1028-1068 | [production] | 
            
  | 14:43 | <bblack> | cp1008/pinkunicorn upgraded to test build of nginx-1.13.5-1+wmf1 | [production] | 
            
  | 14:28 | <volans> | uploaded cumin_1.2.1-1_amd64.deb to apt.wikimedia.org jessie-wikimedia | [production] | 
            
  | 14:24 | <akosiaris> | change wtp1001 to wtp1024 weights to 5 from 15 in preparation for deprecation | [production] | 
            
  | 14:24 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1024.eqiad.wmnet | [production] | 
            
  | 14:24 | <mlitn@tin> | Started scap: Enable 3D extension | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1023.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1022.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1021.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1020.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1019.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1018.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1017.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1016.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1015.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1014.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1013.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1012.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1011.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1010.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1009.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1008.eqiad.wmnet | [production] | 
            
  | 14:23 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1007.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1006.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1005.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1004.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1003.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1002.eqiad.wmnet | [production] | 
            
  | 14:22 | <akosiaris@puppetmaster1001> | conftool action : set/weight=5; selector: name=wtp1001.eqiad.wmnet | [production] | 
            
  | 14:17 | <akosiaris> | T175242 restart eventstreams across the fleet to pick up the change in a rolling restart manner with a batch size of 2 | [production] | 
            
  | 14:16 | <akosiaris> | T175242 restart parsoid across the fleet to pick up the change in a rolling restart manner with a batch size of 5 | [production] | 
            
  | 14:03 | <akosiaris> | T175242 restart tilerator, tileratorui, restbase across the fleet to pick up the change in a rolling restart manner with a batch size of 2 | [production] | 
            
  | 13:43 | <akosiaris> | T175242 re-enable puppet across aqs kafka maps maps-test ores restbase restbase-dev sca scb wtp clusters for merging https://gerrit.wikimedia.org/r/#/c/376500/. Run puppet as well in a batched execution | [production] | 
            
  | 13:42 | <anomie@tin> | Synchronized php-1.31.0-wmf.1/includes/specials/SpecialWatchlist.php: SWAT: {{gerrit|380968}} Fix watchlist "in the last X hours" display (duration: 00m 48s) | [production] | 
            
  | 13:42 | <elukey> | raised Hadoop HDFS namenode master daemon max heap size to 6G (prev 4G) on analytics100[12] | [production] | 
            
  | 13:31 | <akosiaris> | T175242 eventstreams requires manual restart | [production] | 
            
  | 13:25 | <akosiaris> | T175242 parsoid requires manual restart | [production] |