| 2021-08-05
      
      ยง | 
    
  | 17:54 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 17:49 | <ladsgroup@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710315|Increase the shellbox ratio to 5% for wikidata (T176312)]] (duration: 01m 15s) | [production] | 
            
  | 17:43 | <elukey> | upgrade helm3 to 3.6.3-1 on release*, contint*, chartmuseum*, deploy2002 (1002 was already done before) | [production] | 
            
  | 17:43 | <herron> | rolling restart eqiad logstash cluster for java updates | [production] | 
            
  | 17:41 | <ebernhardson> | restart airflow-{scheduler|webserver} on an-airflow1001 to pickup deployed plugin changes | [production] | 
            
  | 17:36 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 17:32 | <ebernhardson@deploy1002> | Finished deploy [wikimedia/discovery/analytics@9872df9]: pyspark generalization gerrit:709837 and 666774 (duration: 09m 01s) | [production] | 
            
  | 17:26 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 17:25 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 17:25 | <Amir1> | end of pdf rebuild on commonswiki (T275268) | [production] | 
            
  | 17:23 | <ebernhardson@deploy1002> | Started deploy [wikimedia/discovery/analytics@9872df9]: pyspark generalization gerrit:709837 and 666774 | [production] | 
            
  | 17:15 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:52 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 16:51 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 16:48 | <hnowlan@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=maps2006.codfw.wmnet | [production] | 
            
  | 16:48 | <ladsgroup@deploy1002> | Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:710297|Enable shellbox for constraints for 1% of wikidata (T176312)]] (duration: 01m 27s) | [production] | 
            
  | 16:47 | <hnowlan@puppetmaster1001> | conftool action : set/pooled=yes; selector: name=maps1010.eqiad.wmnet | [production] | 
            
  | 16:42 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 16:42 | <pt1979@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 16:42 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:36 | <pt1979@cumin2002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 16:21 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 16:21 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:16 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 16:16 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:15 | <mbsantos@deploy1002> | Finished deploy [tilerator/deploy@16dbc04]: maps2006: imposm: add codfw targets (duration: 00m 22s) | [production] | 
            
  | 16:14 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 16:14 | <mbsantos@deploy1002> | Started deploy [tilerator/deploy@16dbc04]: maps2006: imposm: add codfw targets | [production] | 
            
  | 16:14 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:13 | <mbsantos@deploy1002> | Finished deploy [tilerator/deploy@16dbc04]: maps2007: imposm: add codfw targets (duration: 00m 25s) | [production] | 
            
  | 16:12 | <mbsantos@deploy1002> | Started deploy [tilerator/deploy@16dbc04]: maps2007: imposm: add codfw targets | [production] | 
            
  | 16:11 | <mbsantos@deploy1002> | Finished deploy [tilerator/deploy@16dbc04]: maps2008: imposm: add codfw targets (duration: 00m 23s) | [production] | 
            
  | 16:10 | <mbsantos@deploy1002> | Started deploy [tilerator/deploy@16dbc04]: maps2008: imposm: add codfw targets | [production] | 
            
  | 16:10 | <mwdebug-deploy@deploy1002> | helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 16:10 | <mbsantos@deploy1002> | Finished deploy [tilerator/deploy@16dbc04]: maps2009: imposm: add codfw targets (duration: 00m 29s) | [production] | 
            
  | 16:10 | <mbsantos@deploy1002> | Started deploy [tilerator/deploy@16dbc04]: maps2009: imposm: add codfw targets | [production] | 
            
  | 16:09 | <mbsantos@deploy1002> | Finished deploy [tilerator/deploy@16dbc04]: maps2010: imposm: add codfw targets (duration: 00m 22s) | [production] | 
            
  | 16:09 | <mbsantos@deploy1002> | Started deploy [tilerator/deploy@16dbc04]: maps2010: imposm: add codfw targets | [production] | 
            
  | 16:04 | <hnowlan> | draining maps1006 from maps cassandra cluster | [production] | 
            
  | 16:04 | <mbsantos@deploy1002> | Finished deploy [kartotherian/deploy@0ea1846]: maps2006: tegola: mirror 5% of requests everywhere (duration: 00m 24s) | [production] | 
            
  | 16:04 | <mwdebug-deploy@deploy1002> | helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . | [production] | 
            
  | 16:03 | <mbsantos@deploy1002> | Started deploy [kartotherian/deploy@0ea1846]: maps2006: tegola: mirror 5% of requests everywhere | [production] | 
            
  | 16:02 | <hnowlan@cumin1001> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps1006.eqiad.wmnet with reason: Rebuilding as buster replica of maps1009 | [production] | 
            
  | 16:02 | <hnowlan@cumin1001> | START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps1006.eqiad.wmnet with reason: Rebuilding as buster replica of maps1009 | [production] | 
            
  | 16:02 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. | [production] | 
            
  | 16:02 | <elukey@deploy1002> | helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. | [production] | 
            
  | 16:02 | <mbsantos@deploy1002> | Finished deploy [kartotherian/deploy@0ea1846]: maps2010: tegola: mirror 5% of requests everywhere (duration: 00m 21s) | [production] | 
            
  | 16:02 | <hnowlan@puppetmaster1001> | conftool action : set/pooled=no; selector: name=maps1006.eqiad.wmnet | [production] | 
            
  | 16:01 | <mbsantos@deploy1002> | Started deploy [kartotherian/deploy@0ea1846]: maps2010: tegola: mirror 5% of requests everywhere | [production] | 
            
  | 16:01 | <mbsantos@deploy1002> | Finished deploy [kartotherian/deploy@0ea1846]: maps2009: tegola: mirror 5% of requests everywhere (duration: 00m 55s) | [production] |