3901-3950 of 10000 results (7ms)
2026-08-20 §
13:58 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2003.codfw.wmnet [production]
13:58 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2002.codfw.wmnet [production]
13:58 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2002.codfw.wmnet [production]
13:51 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2002.codfw.wmnet [production]
13:41 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2002.codfw.wmnet [production]
13:41 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2001.codfw.wmnet [production]
13:41 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2001.codfw.wmnet [production]
13:34 <klausman@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2001.codfw.wmnet [production]
13:24 <klausman@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2001.codfw.wmnet [production]
2026-08-19 §
06:49 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1222: Depool db1222.eqiad.wmnet to then clone it to db1276.eqiad.wmnet - marostegui@cumin1003 [production]
06:49 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1222: Depool db1222.eqiad.wmnet to then clone it to db1276.eqiad.wmnet - marostegui@cumin1003 [production]
06:10 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2048.codfw.wmnet [production]
05:59 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2048.codfw.wmnet [production]
02:46 <marostegui@cumin1003> dbctl commit (dc=all): 'Depool db2207 T435270', diff saved to https://phabricator.wikimedia.org/P96181 and previous config saved to /var/cache/conftool/dbconfig/20260819-024627-marostegui.json [production]
02:18 <denisse@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2207: Depooling replica [production]
02:18 <denisse@cumin1003> START - Cookbook sre.mysql.depool depool db2207: Depooling replica [production]
2026-08-18 §
15:09 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2044.codfw.wmnet [production]
14:56 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2044.codfw.wmnet [production]
14:51 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2043.codfw.wmnet [production]
14:33 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2043.codfw.wmnet [production]
14:22 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2042.codfw.wmnet [production]
14:04 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2042.codfw.wmnet [production]
14:04 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2041.codfw.wmnet [production]
13:52 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2041.codfw.wmnet [production]
13:51 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2026.codfw.wmnet [production]
13:50 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker-exp1001.eqiad.wmnet [production]
13:50 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker-exp1001.eqiad.wmnet [production]
13:44 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker-exp1001.eqiad.wmnet [production]
13:43 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker-exp1001.eqiad.wmnet [production]
13:43 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1315-1327].eqiad.wmnet [production]
13:43 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1315-1327].eqiad.wmnet [production]
13:35 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1315-1327].eqiad.wmnet [production]
13:27 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1315-1327].eqiad.wmnet [production]
13:27 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1302-1314].eqiad.wmnet [production]
13:26 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1302-1314].eqiad.wmnet [production]
13:18 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1302-1314].eqiad.wmnet [production]
13:11 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1302-1314].eqiad.wmnet [production]
13:10 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1288-1289,1291-1301].eqiad.wmnet [production]
13:10 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1288-1289,1291-1301].eqiad.wmnet [production]
13:02 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1288-1289,1291-1301].eqiad.wmnet [production]
12:53 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1288-1289,1291-1301].eqiad.wmnet [production]
12:53 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1273,1275-1287].eqiad.wmnet [production]
12:53 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1273,1275-1287].eqiad.wmnet [production]
12:44 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1273,1275-1287].eqiad.wmnet [production]
12:37 <dhinus> depool again clouddb10[13,14,16,18,20] that were repooled by the cookbook sre.mysql.multiinstance_reboot [production]
12:36 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1273,1275-1287].eqiad.wmnet [production]
12:36 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1248-1261].eqiad.wmnet [production]
12:36 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1248-1261].eqiad.wmnet [production]
12:27 <cgoubert@cumin2003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1248-1261].eqiad.wmnet [production]
12:19 <cgoubert@cumin2003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1248-1261].eqiad.wmnet [production]