6251-6300 of 10000 results (10ms)
2026-05-21 ยง
13:22 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1004.eqiad.wmnet [production]
13:16 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1031.eqiad.wmnet [production]
13:16 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1030.eqiad.wmnet [production]
13:15 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1004.eqiad.wmnet [production]
13:10 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1004.eqiad.wmnet [production]
13:10 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1003.eqiad.wmnet [production]
13:10 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1003.eqiad.wmnet [production]
13:10 <cwilliams@cumin1003> dbctl commit (dc=all): 'Depool db2241 T426936', diff saved to https://phabricator.wikimedia.org/P92775 and previous config saved to /var/cache/conftool/dbconfig/20260521-131025-cwilliams.json [production]
13:04 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1003.eqiad.wmnet [production]
13:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1030.eqiad.wmnet [production]
12:59 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1003.eqiad.wmnet [production]
12:59 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1002.eqiad.wmnet [production]
12:59 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1002.eqiad.wmnet [production]
12:55 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1029.eqiad.wmnet [production]
12:54 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1002.eqiad.wmnet [production]
12:49 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1002.eqiad.wmnet [production]
12:45 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1029.eqiad.wmnet [production]
12:38 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1052.eqiad.wmnet [production]
12:23 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2003.codfw.wmnet [production]
12:23 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2003.codfw.wmnet [production]
12:22 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1052.eqiad.wmnet [production]
12:20 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1051.eqiad.wmnet [production]
12:20 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) depool all services in codfw/ml-serve-codfw: maintenance [production]
12:19 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster depool all services in codfw/ml-serve-codfw: maintenance [production]
12:19 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) pool all services in codfw/ml-staging-codfw: maintenance [production]
12:19 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster pool all services in codfw/ml-staging-codfw: maintenance [production]
12:19 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) depool all services in codfw/ml-staging-codfw: maintenance [production]
12:18 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster depool all services in codfw/ml-staging-codfw: maintenance [production]
12:17 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2003.codfw.wmnet [production]
12:10 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1051.eqiad.wmnet [production]
12:07 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2003.codfw.wmnet [production]
12:07 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2002.codfw.wmnet [production]
12:07 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2002.codfw.wmnet [production]
12:03 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1050.eqiad.wmnet [production]
12:00 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2002.codfw.wmnet [production]
11:50 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1050.eqiad.wmnet [production]
11:50 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2002.codfw.wmnet [production]
11:50 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2001.codfw.wmnet [production]
11:50 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2001.codfw.wmnet [production]
11:49 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1049.eqiad.wmnet [production]
11:45 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2001.codfw.wmnet [production]
11:37 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1049.eqiad.wmnet [production]
11:35 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1038.eqiad.wmnet [production]
11:35 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2001.codfw.wmnet [production]
11:24 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1038.eqiad.wmnet [production]
11:24 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1034.eqiad.wmnet [production]
11:11 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1034.eqiad.wmnet [production]
11:06 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1033.eqiad.wmnet [production]
10:57 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1033.eqiad.wmnet [production]
10:56 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet [production]