1-50 of 10000 results (48ms)
2026-09-22 ยง
19:44 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1022.eqiad.wmnet [production]
19:42 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir2002.codfw.wmnet with reason: host reimage [production]
19:42 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet [production]
19:42 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:42 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:38 <cdobbins@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir2002.codfw.wmnet with reason: host reimage [production]
19:34 <jclark@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve1016.eqiad.wmnet with OS trixie [production]
19:34 <jclark@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1004" [production]
19:33 <jclark@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1004" [production]
19:25 <sukhe@cumin1004> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from sretest2013 to cp2059 [production]
19:24 <sukhe@cumin1004> START - Cookbook sre.hosts.rename from sretest2013 to cp2059 [production]
19:23 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:22 <sukhe@cumin1004> END (FAIL) - Cookbook sre.hosts.rename (exit_code=93) from sretest2013 to cp2059 [production]
19:21 <sukhe@cumin1004> START - Cookbook sre.hosts.rename from sretest2013 to cp2059 [production]
19:19 <cdobbins@cumin1004> START - Cookbook sre.hosts.reimage for host ncredir2002.codfw.wmnet with OS trixie [production]
19:19 <jclark@cumin1004> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-serve1016.eqiad.wmnet with reason: host reimage [production]
19:17 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1021.eqiad.wmnet [production]
19:17 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1020.eqiad.wmnet [production]
19:17 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1020.eqiad.wmnet [production]
19:15 <jclark@cumin1004> START - Cookbook sre.hosts.downtime for 2:00:00 on ml-serve1016.eqiad.wmnet with reason: host reimage [production]
19:01 <ebernhardson> Rolling restart opensearch-semantic-search in dse-k8s-codfw to update to opensearch 3.8.0 [production]
18:58 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1020.eqiad.wmnet [production]
18:56 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1020.eqiad.wmnet [production]
18:56 <jclark@cumin1004> START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie [production]
18:56 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1019.eqiad.wmnet [production]
18:56 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1019.eqiad.wmnet [production]
18:55 <dancy@deploy1003> Installation of scap version "4.291.0" completed for 2 hosts [production]
18:53 <dancy@deploy1003> Installing scap version "4.291.0" for 2 host(s) [production]
18:53 <dancy@deploy1003> Installation of scap version "4.291.0" completed for 3 hosts [production]
18:51 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:49 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1019.eqiad.wmnet [production]
18:49 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1019.eqiad.wmnet [production]
18:49 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:49 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:47 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:44 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:43 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:41 <dancy@deploy1003> install-world aborted: (no justification provided) (duration: 00m 48s) [production]
18:41 <dancy@deploy1003> Installing scap version "4.291.0" for 3 host(s) [production]
18:40 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:36 <jhuneidi@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.21 refs T438217 [production]
18:35 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1018.eqiad.wmnet [production]
18:35 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:35 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:18 <btullis@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:16 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1014.eqiad.wmnet [production]
18:16 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:16 <btullis@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:09 <btullis@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1013.eqiad.wmnet [production]
18:07 <ebernhardson> Rolling restart opensearch-semantic-search in dse-k8s-eqiad to update to opensearch 3.8.0 [production]