8801-8850 of 10000 results (9ms)
2025-06-30 §
16:45 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5005.eqsin.wmnet [production]
14:39 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2020.codfw.wmnet [production]
14:23 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5005.eqsin.wmnet [production]
14:09 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5005.eqsin.wmnet [production]
14:08 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5005.eqsin.wmnet [production]
14:08 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti5005.eqsin.wmnet [production]
14:08 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5005.eqsin.wmnet [production]
11:47 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5004.eqsin.wmnet [production]
11:29 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2020.codfw.wmnet [production]
11:29 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2020.codfw.wmnet [production]
11:21 <Emperor> depool eqiad ms-swift for container DB repairs T383053 [production]
11:20 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2020.codfw.wmnet [production]
10:47 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
10:40 <vgutierrez> depool cp7001 [production]
10:05 <Emperor> depool codfw ms-swift for container DB repairs T383053 [production]
09:43 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5004.eqsin.wmnet [production]
09:20 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
09:19 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
09:18 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
09:04 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5004.eqsin.wmnet [production]
09:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5004.eqsin.wmnet [production]
08:12 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
08:10 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
08:07 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
08:04 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
07:33 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
07:15 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
2025-06-27 §
07:26 <fabfur> depool cp7007 for testing (T397917) [production]
2025-06-26 §
18:17 <jasmine@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1032-1033].eqiad.wmnet [production]
18:15 <jasmine@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1032-1033].eqiad.wmnet [production]
16:30 <fabfur> depool cp7006 for a quick test (T397917) [production]
14:20 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2022.codfw.wmnet [production]
11:51 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2022.codfw.wmnet [production]
11:46 <jmm@cumin1003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2022.codfw.wmnet [production]
11:44 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2022.codfw.wmnet [production]
11:44 <jmm@cumin1003> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2019.codfw.wmnet [production]
11:43 <jmm@cumin1003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2019.codfw.wmnet [production]
2025-06-25 §
15:27 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1166-1168,1240-1242,1244-1251].eqiad.wmnet [production]
15:26 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1166-1168,1240-1242,1244-1251].eqiad.wmnet [production]
14:17 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Depool db2161 T397164', diff saved to https://phabricator.wikimedia.org/P78685 and previous config saved to /var/cache/conftool/dbconfig/20250625-141729-ladsgroup.json [production]
11:40 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1061-1068,1070-1075].eqiad.wmnet [production]
11:40 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1061-1068,1070-1075].eqiad.wmnet [production]
2025-06-24 §
07:02 <fabfur> disable puppet on cp7001 and depool to test new hiddenparma/varnish/haproxy syntax (T396621) [production]
2025-06-23 §
14:13 <kamila@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) pool all services in codfw/codfw: maintenance [production]
14:01 <kamila@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster pool all services in codfw/codfw: maintenance [production]
10:36 <kamila@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) depool all services in codfw/codfw: maintenance [production]
10:24 <kamila@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster depool all services in codfw/codfw: maintenance [production]
10:23 <kamila@cumin1003> END (ERROR) - Cookbook sre.k8s.pool-depool-cluster (exit_code=93) depool all services in codfw/codfw: maintenance [production]
10:11 <kamila@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster depool all services in codfw/codfw: maintenance [production]
09:22 <marostegui@cumin1002> dbctl commit (dc=all): 'Depool db1222', diff saved to https://phabricator.wikimedia.org/P78605 and previous config saved to /var/cache/conftool/dbconfig/20250623-092230-root.json [production]