7551-7600 of 10000 results (10ms)
2026-04-07 §
08:38 <jmm@cumin2002> END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti5007.eqsin.wmnet [production]
08:37 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti5007.eqsin.wmnet [production]
05:37 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1169: Upgrade package [production]
05:37 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1169: Upgrade package [production]
05:37 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2142: Upgrade package [production]
05:36 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2142: Upgrade package [production]
05:35 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2248: Upgrade package [production]
05:35 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2248: Upgrade package [production]
05:33 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2248: Upgrade package [production]
05:33 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2248: Upgrade package [production]
05:31 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249.codfw.wmnet: Upgrade package [production]
05:31 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249.codfw.wmnet: Upgrade package [production]
05:31 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249: Upgrade package [production]
05:31 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249: Upgrade package [production]
05:30 <marostegui@cumin1003> END (FAIL) - Cookbook sre.mysql.depool (exit_code=99) depool db2249: Upgrade package [production]
05:30 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2249: Upgrade package [production]
2026-04-06 §
09:01 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1152: Upgrade [production]
09:01 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1152: Upgrade [production]
09:00 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1169: test [production]
08:59 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db1169: test [production]
2026-03-31 §
09:58 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1347.eqiad.wmnet [production]
09:58 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1347.eqiad.wmnet [production]
09:52 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1347.eqiad.wmnet [production]
09:52 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1347.eqiad.wmnet [production]
2026-03-30 §
13:19 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4005.ulsfo.wmnet [production]
13:10 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4005.ulsfo.wmnet [production]
12:01 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti4006.ulsfo.wmnet [production]
11:52 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti4006.ulsfo.wmnet [production]
2026-03-26 §
13:56 <jiji@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1070.eqiad.wmnet [production]
13:55 <jiji@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1070.eqiad.wmnet [production]
13:55 <jiji@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1097.eqiad.wmnet [production]
13:55 <jiji@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1097.eqiad.wmnet [production]
13:54 <jiji@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1055.eqiad.wmnet [production]
13:53 <jiji@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1055.eqiad.wmnet [production]
11:32 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1202: Depool db1202.eqiad.wmnet to then clone it to db1253.eqiad.wmnet - fceratto@cumin1003 [production]
11:31 <fceratto@cumin1003> START - Cookbook sre.mysql.depool depool db1202: Depool db1202.eqiad.wmnet to then clone it to db1253.eqiad.wmnet - fceratto@cumin1003 [production]
2026-03-25 §
21:27 <ryankemper> [opensearch-k8s] T414484 Getting ready to depool `dnsdisc=k8s-ingress-dse-aa,name=eqiad`, leaving codfw pooled. This will get us ready for a full rolling-upgrade of the dse-k8s-eqiad cluster tomorrow. [production]
2026-03-24 §
15:46 <blake@cumin1003> END (PASS) - Cookbook sre.discovery.datacenter (exit_code=0) depool all services in codfw: Datacenter Switchover - T413974 [production]
15:20 <blake@cumin1003> START - Cookbook sre.discovery.datacenter depool all services in codfw: Datacenter Switchover - T413974 [production]
14:59 <blake@cumin1003> END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool codfw [reason: no reason specified, no task ID specified] [production]
14:59 <blake@cumin1003> START - Cookbook sre.dns.admin DNS admin: depool codfw [reason: no reason specified, no task ID specified] [production]
08:45 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1170: Degraded drive T420873 [production]
08:45 <fceratto@cumin1003> START - Cookbook sre.mysql.depool depool db1170: Degraded drive T420873 [production]
2026-03-23 §
14:14 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2352-2356].codfw.wmnet [production]
14:14 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2352-2356].codfw.wmnet [production]
14:07 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2352-2356].codfw.wmnet [production]
14:04 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2352-2356].codfw.wmnet [production]
14:03 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2347-2351].codfw.wmnet [production]
14:03 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2347-2351].codfw.wmnet [production]
13:57 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2347-2351].codfw.wmnet [production]