1-50 of 10000 results (13ms)
2026-10-15 ยง
15:15 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2327.codfw.wmnet [production]
15:15 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2327.codfw.wmnet [production]
15:14 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2326.codfw.wmnet [production]
15:14 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2326.codfw.wmnet [production]
15:14 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:12 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1342.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:12 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1342.eqiad.wmnet [production]
15:12 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1342.eqiad.wmnet [production]
15:11 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1341.eqiad.wmnet [production]
15:11 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1341.eqiad.wmnet [production]
15:11 <cdobbins@cumin1004> START - Cookbook sre.hosts.reboot-single for host cp2047.codfw.wmnet [production]
15:10 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:09 <cdobbins@cumin1004> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2047.codfw.wmnet [production]
15:09 <pt1979@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 14 hosts with reason: Junos upgrade [production]
15:09 <cdobbins@cumin1004> conftool action : set/pooled=no; selector: name=cp2047.* [production]
15:09 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:08 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2326.codfw.wmnet [production]
15:08 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2326.codfw.wmnet [production]
15:07 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2325.codfw.wmnet [production]
15:07 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade [production]
15:06 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade [production]
15:06 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2325.codfw.wmnet [production]
15:06 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:03 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:03 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1341.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1341.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1340.eqiad.wmnet [production]
15:02 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1340.eqiad.wmnet [production]
15:02 <pt1979@cumin1004> DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 33 hosts with reason: Junos upgrade [production]
15:01 <moritzm> installing unbound security updates [production]
15:00 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:00 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2325.codfw.wmnet [production]
15:00 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2325.codfw.wmnet [production]
14:59 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2324.codfw.wmnet [production]
14:59 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2324.codfw.wmnet [production]
14:58 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:57 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance [production]
14:56 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1287.eqiad.wmnet with reason: Maintenance [production]
14:56 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1282.eqiad.wmnet with reason: Maintenance [production]
14:56 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 6 hosts with reason: Maintenance [production]
14:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1279.eqiad.wmnet with reason: Maintenance [production]
14:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1241.eqiad.wmnet with reason: Maintenance [production]
14:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1225.eqiad.wmnet with reason: Maintenance [production]
14:55 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1201.eqiad.wmnet with reason: Maintenance [production]
14:54 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1187.eqiad.wmnet with reason: Maintenance [production]
14:54 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1168.eqiad.wmnet with reason: Maintenance [production]
14:54 <marostegui@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
14:53 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART [production]
14:53 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2324.codfw.wmnet [production]
14:52 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2324.codfw.wmnet [production]