5651-5700 of 10000 results (9ms)
2026-06-24 §
07:50 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1199: Upgrading db1199.eqiad.wmnet [production]
07:11 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet [production]
07:09 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet [production]
07:08 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet [production]
06:54 <jmm@cumin2003> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2046.codfw.wmnet [production]
06:54 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2046.codfw.wmnet [production]
06:54 <jmm@cumin2003> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2028.codfw.wmnet [production]
06:53 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet [production]
05:56 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: Upgrading es1035.eqiad.wmnet [production]
05:55 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1035: Upgrading es1035.eqiad.wmnet [production]
05:45 <marostegui@cumin1003> dbctl commit (dc=all): 'Depool es1035 T429867', diff saved to https://phabricator.wikimedia.org/P94395 and previous config saved to /var/cache/conftool/dbconfig/20260624-054547-marostegui.json [production]
2026-06-23 §
15:18 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2172: Upgrading db2172.codfw.wmnet [production]
15:17 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2172: Upgrading db2172.codfw.wmnet [production]
14:35 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1190: Upgrading db1190.eqiad.wmnet [production]
14:34 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1190: Upgrading db1190.eqiad.wmnet [production]
12:55 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2155: Upgrading db2155.codfw.wmnet [production]
12:55 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2155: Upgrading db2155.codfw.wmnet [production]
12:49 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1160: Upgrading db1160.eqiad.wmnet [production]
12:49 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1160: Upgrading db1160.eqiad.wmnet [production]
12:22 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2002.codfw.wmnet [production]
12:22 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2002.codfw.wmnet [production]
12:18 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2002.codfw.wmnet [production]
12:18 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2002.codfw.wmnet [production]
12:18 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2001.codfw.wmnet [production]
12:18 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2001.codfw.wmnet [production]
12:15 <klausman@cumin2002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2001.codfw.wmnet [production]
12:15 <klausman@cumin2002> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2001.codfw.wmnet [production]
08:33 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Maintenance on pc8 [production]
08:33 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc1018: Maintenance on pc8 [production]
07:34 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Maintenance on pc2 [production]
07:34 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc1018: Maintenance on pc2 [production]
06:32 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1018: Reimage to Trixie [production]
06:32 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc1018: Reimage to Trixie [production]
06:14 <fceratto@cumin1003> dbctl commit (dc=all): 'Depool db1201 T429868', diff saved to https://phabricator.wikimedia.org/P94338 and previous config saved to /var/cache/conftool/dbconfig/20260623-061416-fceratto.json [production]
05:41 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2018: Reimage to Trixie [production]
05:41 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc2018: Reimage to Trixie [production]
05:12 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2038: Upgrading es2038.codfw.wmnet [production]
05:12 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es2038: Upgrading es2038.codfw.wmnet [production]
05:10 <marostegui@cumin1003> dbctl commit (dc=all): 'Depool es2038 T429794', diff saved to https://phabricator.wikimedia.org/P94332 and previous config saved to /var/cache/conftool/dbconfig/20260623-051012-marostegui.json [production]
2026-06-22 §
13:25 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1039: Upgrading es1039.eqiad.wmnet [production]
13:25 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1039: Upgrading es1039.eqiad.wmnet [production]
11:02 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1040: Upgrading es1040.eqiad.wmnet [production]
10:59 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1040: Upgrading es1040.eqiad.wmnet [production]
09:09 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1017: Reimage to Trixie [production]
09:09 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc1017: Reimage to Trixie [production]
08:21 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2017: Reimage to Trixie [production]
08:21 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc2017: Reimage to Trixie [production]
08:15 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1048: Upgrading es1048.eqiad.wmnet [production]
08:12 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2017: pc7 migration to debian trixie [production]
08:12 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool pc2017: pc7 migration to debian trixie [production]