| 2021-07-30
      
      ยง | 
    
  | 21:50 | <legoktm@deploy1002> | helmfile [eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 21:49 | <legoktm@deploy1002> | helmfile [eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 21:49 | <legoktm@deploy1002> | helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 21:48 | <legoktm@deploy1002> | helmfile [staging-eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 21:47 | <legoktm@deploy1002> | helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 21:46 | <legoktm@deploy1002> | helmfile [staging-codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 20:39 | <ottomata> | wiping kafka jumbo cluster in deployment-prep beta | [production] | 
            
  | 19:44 | <otto@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: Declare wd_propertysuggester streams - T287760 (duration: 00m 57s) | [production] | 
            
  | 16:13 | <oblivian@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 16:10 | <oblivian@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:58 | <oblivian@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:33 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[1298-1299].eqiad.wmnet | [production] | 
            
  | 15:30 | <oblivian@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 15:20 | <dzahn@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw[1298-1299].eqiad.wmnet | [production] | 
            
  | 15:19 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw129[8-9].eqiad.wmnet | [production] | 
            
  | 15:19 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw129[5-6].eqiad.wmnet | [production] | 
            
  | 15:17 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts mw[1295-1296].eqiad.wmnet | [production] | 
            
  | 15:12 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 15:07 | <dzahn@cumin1001> | START - Cookbook sre.hosts.decommission for hosts mw[1295-1296].eqiad.wmnet | [production] | 
            
  | 15:04 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 14:58 | <mutante> | mw1439, mw1440, mw1445, mw1446 - scap pull, repool as jobrunners after reimaging | [production] | 
            
  | 14:55 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw144[5-6].eqiad.wmnet | [production] | 
            
  | 14:53 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw1440.eqiad.wmnet | [production] | 
            
  | 14:52 | <dzahn@cumin1001> | conftool action : set/pooled=yes; selector: name=mw1439.eqiad.wmnet | [production] | 
            
  | 14:46 | <dzahn@cumin1001> | conftool action : set/weight=10; selector: name=mw144[5-6].eqiad.wmnet | [production] | 
            
  | 14:46 | <dzahn@cumin1001> | conftool action : set/weight=10; selector: name=mw1440.eqiad.wmnet | [production] | 
            
  | 14:46 | <dzahn@cumin1001> | conftool action : set/weight=10; selector: name=mw1439.eqiad.wmnet | [production] | 
            
  | 14:39 | <topranks> | Setting up BGP peering to Xiber LLC AS393950 on cr2-eqord, Equinix Chicago exchange. | [production] | 
            
  | 14:21 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1446.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:19 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1445.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:18 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1446.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:17 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1440.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:16 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1445.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:15 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw1439.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:14 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1440.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 14:12 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 2:00:00 on mw1439.eqiad.wmnet with reason: REIMAGE | [production] | 
            
  | 13:57 | <mutante> | mw1439,mw1440,mw1445,mw1446 - converting from app/API to jobrunners - reimaging for row balance in eqiad | [production] | 
            
  | 13:53 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mw[1439-1440].eqiad.wmnet with reason: reimage | [production] | 
            
  | 13:53 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 4:00:00 on mw[1439-1440].eqiad.wmnet with reason: reimage | [production] | 
            
  | 13:53 | <dzahn@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mw[1445-1446].eqiad.wmnet with reason: reimage | [production] | 
            
  | 13:53 | <dzahn@cumin1001> | START - Cookbook sre.hosts.downtime for 4:00:00 on mw[1445-1446].eqiad.wmnet with reason: reimage | [production] | 
            
  | 13:26 | <joe> | uploaded docker-report 0.0.13 to buster | [production] | 
            
  | 13:23 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw144[5-6].eqiad.wmnet | [production] | 
            
  | 13:22 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw1440.eqiad.wmnet | [production] | 
            
  | 13:22 | <dzahn@cumin1001> | conftool action : set/pooled=inactive; selector: name=mw1439.eqiad.wmnet | [production] | 
            
  | 11:23 | <moritzm> | installing libsndfile security updates on stretch | [production] | 
            
  | 09:38 | <mbsantos@deploy1002> | Finished deploy [kartotherian/deploy@289d3a9]: Add public source to render tegola MVT in maps2007 temporarily (duration: 00m 21s) | [production] | 
            
  | 09:37 | <mbsantos@deploy1002> | Started deploy [kartotherian/deploy@289d3a9]: Add public source to render tegola MVT in maps2007 temporarily | [production] | 
            
  | 09:32 | <mbsantos@deploy1002> | Finished deploy [kartotherian/deploy@c6cfa85]: Add non-public source to render tegola MVT in maps2007 (duration: 00m 21s) | [production] | 
            
  | 09:32 | <mbsantos@deploy1002> | Started deploy [kartotherian/deploy@c6cfa85]: Add non-public source to render tegola MVT in maps2007 | [production] |