51-100 of 10000 results (132ms)
2026-05-18 ยง
20:14 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:13 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:13 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:05 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
19:56 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:48 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:40 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:39 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:39 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:29 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:21 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:20 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:20 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:12 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:03 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:02 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
19:02 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:54 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:48 <jhathaway@dns1004> END - running authdns-update [production]
18:46 <jhathaway@dns1004> START - running authdns-update [production]
18:45 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:45 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:44 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:38 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gitlab2003.wikimedia.org with reason: T426563 [production]
18:35 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:32 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host gitlab-runner2004.codfw.wmnet [production]
18:32 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host gitlab-runner2004.codfw.wmnet [production]
18:31 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host gitlab-runner2004.codfw.wmnet [production]
18:31 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host gitlab-runner2004.codfw.wmnet [production]
18:30 <herron@cumin1003> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host centrallog1002.eqiad.wmnet [production]
18:30 <herron@cumin1003> START - Cookbook sre.hosts.reboot-single for host centrallog1002.eqiad.wmnet [production]
18:26 <herron> rebooting alert1002 [production]
18:26 <swfrench@cumin1003> START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{wikikube-worker[2203-2331].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
18:22 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2191-2202].codfw.wmnet [production]
18:22 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2191-2202].codfw.wmnet [production]
18:20 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host gitlab-runner2003.codfw.wmnet [production]
18:20 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gitlab-runner2002.codfw.wmnet [production]
18:19 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2189.codfw.wmnet [production]
18:19 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2189.codfw.wmnet [production]
18:16 <mutante> releases.wikimedia.org - rebooting backends [production]
18:16 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on releases2003.codfw.wmnet with reason: T426563 [production]
18:13 <herron@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host kafkamon1003.eqiad.wmnet [production]
18:13 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host gitlab-runner2002.codfw.wmnet [production]
18:13 <dzahn@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host gitlab-runner1004.eqiad.wmnet [production]
18:11 <herron@cumin1003> START - Cookbook sre.hosts.reboot-single for host kafkamon1003.eqiad.wmnet [production]
18:11 <herron@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host kafkamon2003.codfw.wmnet [production]
18:07 <herron@cumin1003> START - Cookbook sre.hosts.reboot-single for host kafkamon2003.codfw.wmnet [production]
18:06 <dzahn@cumin2002> START - Cookbook sre.hosts.reboot-single for host gitlab-runner1004.eqiad.wmnet [production]