6401-6450 of 10000 results (44ms)
2021-08-05 ยง
16:21 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:16 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:16 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:15 <mbsantos@deploy1002> Finished deploy [tilerator/deploy@16dbc04]: maps2006: imposm: add codfw targets (duration: 00m 22s) [production]
16:14 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:14 <mbsantos@deploy1002> Started deploy [tilerator/deploy@16dbc04]: maps2006: imposm: add codfw targets [production]
16:14 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:13 <mbsantos@deploy1002> Finished deploy [tilerator/deploy@16dbc04]: maps2007: imposm: add codfw targets (duration: 00m 25s) [production]
16:12 <mbsantos@deploy1002> Started deploy [tilerator/deploy@16dbc04]: maps2007: imposm: add codfw targets [production]
16:11 <mbsantos@deploy1002> Finished deploy [tilerator/deploy@16dbc04]: maps2008: imposm: add codfw targets (duration: 00m 23s) [production]
16:10 <mbsantos@deploy1002> Started deploy [tilerator/deploy@16dbc04]: maps2008: imposm: add codfw targets [production]
16:10 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:10 <mbsantos@deploy1002> Finished deploy [tilerator/deploy@16dbc04]: maps2009: imposm: add codfw targets (duration: 00m 29s) [production]
16:10 <mbsantos@deploy1002> Started deploy [tilerator/deploy@16dbc04]: maps2009: imposm: add codfw targets [production]
16:09 <mbsantos@deploy1002> Finished deploy [tilerator/deploy@16dbc04]: maps2010: imposm: add codfw targets (duration: 00m 22s) [production]
16:09 <mbsantos@deploy1002> Started deploy [tilerator/deploy@16dbc04]: maps2010: imposm: add codfw targets [production]
16:04 <hnowlan> draining maps1006 from maps cassandra cluster [production]
16:04 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0ea1846]: maps2006: tegola: mirror 5% of requests everywhere (duration: 00m 24s) [production]
16:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:03 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846]: maps2006: tegola: mirror 5% of requests everywhere [production]
16:02 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps1006.eqiad.wmnet with reason: Rebuilding as buster replica of maps1009 [production]
16:02 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps1006.eqiad.wmnet with reason: Rebuilding as buster replica of maps1009 [production]
16:02 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:02 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:02 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0ea1846]: maps2010: tegola: mirror 5% of requests everywhere (duration: 00m 21s) [production]
16:02 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps1006.eqiad.wmnet [production]
16:01 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846]: maps2010: tegola: mirror 5% of requests everywhere [production]
16:01 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0ea1846]: maps2009: tegola: mirror 5% of requests everywhere (duration: 00m 55s) [production]
16:01 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
16:00 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
16:00 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846]: maps2009: tegola: mirror 5% of requests everywhere [production]
15:59 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0ea1846]: maps2008: tegola: mirror 5% of requests everywhere (duration: 00m 21s) [production]
15:59 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846]: maps2008: tegola: mirror 5% of requests everywhere [production]
15:59 <dcausse@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'rdf-streaming-updater' for release 'main' . [production]
15:59 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0ea1846]: tegola: mirror 5% of requests everywhere (duration: 00m 22s) [production]
15:58 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846]: tegola: mirror 5% of requests everywhere [production]
15:57 <mbsantos@deploy1002> deploy aborted: tegola: mirror 5% of requests everywhere (duration: 00m 03s) [production]
15:57 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0ea1846] (imposm): tegola: mirror 5% of requests everywhere [production]
15:54 <herron> rolling restart codfw logstash elasticsearch cluster for java updates [production]
15:52 <elukey> upgrade helm3 to 3.6.3-1 on deploy1002 [production]
15:28 <vgutierrez> pool lvs2009 - T286881 [production]
15:27 <mbsantos@deploy1002> Finished deploy [kartotherian/deploy@0a38bc5]: Deploy imposm to maps2006 (duration: 00m 20s) [production]
15:27 <mbsantos@deploy1002> Started deploy [kartotherian/deploy@0a38bc5]: Deploy imposm to maps2006 [production]
15:11 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lvs2009.codfw.wmnet with reason: T286881 [production]
15:11 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on lvs2009.codfw.wmnet with reason: T286881 [production]
15:11 <vgutierrez> depool lvs2009 - T286881 [production]
15:10 <vgutierrez> pool lvs2008 - T286881 [production]
14:53 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lvs2008.codfw.wmnet with reason: T286881 [production]
14:53 <vgutierrez@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on lvs2008.codfw.wmnet with reason: T286881 [production]
14:52 <vgutierrez> depool lvs2008 - T286881 [production]