301-350 of 10000 results (17ms)
2026-10-15 ยง
15:56 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2225.codfw.wmnet with reason: Maintenance [production]
15:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2207.codfw.wmnet with reason: Maintenance [production]
15:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2197.codfw.wmnet with reason: Maintenance [production]
15:54 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2189.codfw.wmnet with reason: Maintenance [production]
15:54 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2175.codfw.wmnet with reason: Maintenance [production]
15:52 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1173.eqiad.wmnet with reason: Maintenance [production]
15:52 <ebernhardson@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
15:52 <ebernhardson@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
15:49 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
15:49 <ebernhardson@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
15:40 <cmooney@cumin1004> START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie [production]
15:33 <cdobbins@cumin1004> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2047.codfw.wmnet [production]
15:28 <cmooney@cumin1004> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "sync switches in eqiad a and b changed to state active in netbox - cmooney@cumin1004" [production]
15:28 <cmooney@cumin1004> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "sync switches in eqiad a and b changed to state active in netbox - cmooney@cumin1004" [production]
15:21 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1343.eqiad.wmnet [production]
15:21 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1343.eqiad.wmnet [production]
15:21 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1342.eqiad.wmnet [production]
15:20 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1342.eqiad.wmnet [production]
15:19 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1342.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:19 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply [production]
15:19 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply [production]
15:15 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2327.codfw.wmnet [production]
15:15 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2327.codfw.wmnet [production]
15:14 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2326.codfw.wmnet [production]
15:14 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2326.codfw.wmnet [production]
15:14 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:12 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1342.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:12 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1342.eqiad.wmnet [production]
15:12 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1342.eqiad.wmnet [production]
15:11 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1341.eqiad.wmnet [production]
15:11 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1341.eqiad.wmnet [production]
15:11 <cdobbins@cumin1004> START - Cookbook sre.hosts.reboot-single for host cp2047.codfw.wmnet [production]
15:10 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:09 <cdobbins@cumin1004> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2047.codfw.wmnet [production]
15:09 <pt1979@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 14 hosts with reason: Junos upgrade [production]
15:09 <cdobbins@cumin1004> conftool action : set/pooled=no; selector: name=cp2047.* [production]
15:09 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:08 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2326.codfw.wmnet [production]
15:08 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2326.codfw.wmnet [production]
15:07 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2325.codfw.wmnet [production]
15:07 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade [production]
15:06 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade [production]
15:06 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2325.codfw.wmnet [production]
15:06 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:03 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:03 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1341.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1341.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1340.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1340.eqiad.wmnet [production]
15:02 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 33 hosts with reason: Junos upgrade [production]