6051-6100 of 10000 results (14ms)
2026-06-01 §
15:48 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2027.codfw.wmnet [production]
14:52 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1209: Upgrading db1209.eqiad.wmnet [production]
14:52 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1209: Upgrading db1209.eqiad.wmnet [production]
13:22 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) pool all services in eqiad/ml-serve-eqiad: maintenance [production]
13:21 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster pool all services in eqiad/ml-serve-eqiad: maintenance [production]
12:28 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2027.codfw.wmnet [production]
12:26 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2027.codfw.wmnet [production]
12:26 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2027.codfw.wmnet [production]
12:15 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) depool all services in eqiad/ml-serve-eqiad: maintenance [production]
12:15 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster depool all services in eqiad/ml-serve-eqiad: maintenance [production]
12:05 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2027.codfw.wmnet [production]
12:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2027.codfw.wmnet [production]
12:04 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2027.codfw.wmnet [production]
12:04 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2027.codfw.wmnet [production]
11:59 <dpogorzelski@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-cluster (exit_code=0) pool all services in eqiad/ml-serve-eqiad: maintenance [production]
11:59 <dpogorzelski@cumin1003> START - Cookbook sre.k8s.pool-depool-cluster pool all services in eqiad/ml-serve-eqiad: maintenance [production]
09:38 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1055: Upgrading es1055.eqiad.wmnet [production]
09:38 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1055: Upgrading es1055.eqiad.wmnet [production]
09:12 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1177: Upgrading db1177.eqiad.wmnet [production]
09:11 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1177: Upgrading db1177.eqiad.wmnet [production]
2026-05-28 §
06:16 <fceratto@cumin1003> dbctl commit (dc=all): 'Depool db1209 T426095', diff saved to https://phabricator.wikimedia.org/P93301 and previous config saved to /var/cache/conftool/dbconfig/20260528-061609-fceratto.json [production]
2026-05-27 §
15:51 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2163: Testing cookbook [production]
15:50 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2163: Testing cookbook [production]
14:08 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2163: Upgrading db2163.codfw.wmnet [production]
14:08 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2163: Upgrading db2163.codfw.wmnet [production]
14:07 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1178: Upgrading db1178.eqiad.wmnet [production]
14:07 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1178: Upgrading db1178.eqiad.wmnet [production]
13:15 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2189: Test [production]
13:15 <fceratto@cumin1003> START - Cookbook sre.mysql.depool depool db2189: Test [production]
12:20 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2164: Upgrading db2164.codfw.wmnet [production]
12:20 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2164: Upgrading db2164.codfw.wmnet [production]
12:19 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1192: Upgrading db1192.eqiad.wmnet [production]
12:18 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1192: Upgrading db1192.eqiad.wmnet [production]
12:12 <fceratto@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2189: Test [production]
12:11 <fceratto@cumin1003> START - Cookbook sre.mysql.depool depool db2189: Test [production]
11:00 <marostegui@cumin1003> dbctl commit (dc=all): 'Depool db2189', diff saved to https://phabricator.wikimedia.org/P93226 and previous config saved to /var/cache/conftool/dbconfig/20260527-110016-marostegui.json [production]
10:36 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1193: Upgrading db1193.eqiad.wmnet [production]
10:35 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1193: Upgrading db1193.eqiad.wmnet [production]
10:35 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2165: Upgrading db2165.codfw.wmnet [production]
10:35 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2165: Upgrading db2165.codfw.wmnet [production]
09:26 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1050: Upgrading es1050.eqiad.wmnet [production]
09:25 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es1050: Upgrading es1050.eqiad.wmnet [production]
08:36 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1203: Upgrading db1203.eqiad.wmnet [production]
08:36 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db1203: Upgrading db1203.eqiad.wmnet [production]
08:34 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2166: Upgrading db2166.codfw.wmnet [production]
08:33 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2166: Upgrading db2166.codfw.wmnet [production]
07:42 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2051: Upgrading es2051.codfw.wmnet [production]
07:42 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es2051: Upgrading es2051.codfw.wmnet [production]
05:40 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2055: Upgrading es2055.codfw.wmnet [production]
05:40 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool es2055: Upgrading es2055.codfw.wmnet [production]