51-100 of 10000 results (17ms)
2026-05-18 ยง
21:14 <dzahn@cumin2002> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:15:00 on gerrit-replica.wikimedia.org with reason: T426563 [production]
21:12 <James_F> Zuul: [operations/software/gerrit] Add Node26 as experimental [releng]
21:10 <mutante> gerrit-replica.wikimedia.org, gerrit-spare.wikimedia.org - rebooting backends [releng]
21:10 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit2002.wikimedia.org with reason: T426563 [production]
21:10 <mutante> gerrit-replica.wikimedia.org, gerrit-spare.wikimedia.org - rebooting backends [production]
21:09 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gerrit1003.wikimedia.org with reason: T426563 [production]
20:57 <James_F> Zuul: [integration/docroot] Test in PHP 8.3+, dropping 8.2 [releng]
20:56 <James_F> Zuul: [analytics/wmde/scripts] Test in PHP 8.3+, dropping 8. [releng]
20:45 <eileen> civicrm upgraded from 150d484e to bfa13f7f [fundraising]
20:35 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:34 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) (T426563) [admin]
20:34 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:33 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=99) (T426563) [admin]
20:33 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T426563) [admin]
20:30 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on P{wikikube-worker[2203-2331].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
20:30 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:30 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:22 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:18 <James_F> Zuul: [wikimedia/fundraising/dash] Replace Node 20 testing with Node 24 [releng]
20:18 <James_F> Zuul: Migrate various labs things to Node 24 [releng]
20:14 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2317-2330].codfw.wmnet [production]
20:13 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:13 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:05 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
20:02 <James_F> Docker: [ajv, sonar-scanner] Migrate to Node 24 [releng]
19:58 <James_F> Zuul: Migrate various production/CI things to Node 24 [releng]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2303-2316].codfw.wmnet [production]
19:56 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:56 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:48 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:40 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2289-2302].codfw.wmnet [production]
19:39 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:39 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:29 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:21 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2275-2288].codfw.wmnet [production]
19:20 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:20 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:12 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:03 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2261-2274].codfw.wmnet [production]
19:02 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
19:02 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:54 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:48 <jhathaway@dns1004> END - running authdns-update [production]
18:46 <jhathaway@dns1004> START - running authdns-update [production]
18:45 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2243,2248-2260].codfw.wmnet [production]
18:45 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:44 <swfrench@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:38 <dzahn@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on gitlab2003.wikimedia.org with reason: T426563 [production]
18:35 <swfrench@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2203-2215,2242].codfw.wmnet [production]
18:32 <dzahn@cumin2002> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host gitlab-runner2004.codfw.wmnet [production]