151-200 of 10000 results (117ms)
2026-07-09 ยง
12:18 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast4006.wikimedia.org [production]
12:18 <bwojtowicz@deploy2003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
12:18 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.host-bgp (exit_code=0) for host ml-serve1004 [production]
12:18 <cmooney@cumin1003> START - Cookbook sre.network.host-bgp for host ml-serve1004 [production]
12:14 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host apt2002.wikimedia.org [production]
12:14 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host bast7002.wikimedia.org [production]
12:10 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[2003,2014].codfw.wmnet with reason: reboot & upgrade [production]
12:10 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt-staging2001.codfw.wmnet [production]
12:09 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid1003.eqiad.wmnet [production]
12:06 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host apt-staging2001.codfw.wmnet [production]
12:05 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host failoid1003.eqiad.wmnet [production]
12:03 <jynus@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[1003,1014].eqiad.wmnet with reason: reboot & upgrade [production]
12:02 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid2003.codfw.wmnet [production]
12:02 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org [production]
11:58 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host failoid2003.codfw.wmnet [production]
11:58 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host irc1003.wikimedia.org [production]
11:55 <jmm@dns1004> END - running authdns-update [production]
11:53 <jmm@dns1004> START - running authdns-update [production]
11:50 <jmm@dns1004> END - running authdns-update [production]
11:48 <jmm@dns1004> START - running authdns-update [production]
11:27 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2003.wikimedia.org [production]
11:23 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host irc2003.wikimedia.org [production]
11:16 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-maint2001.codfw.wmnet [production]
11:16 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-maint1001.eqiad.wmnet [production]
11:12 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-maint2001.codfw.wmnet [production]
11:12 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-maint1001.eqiad.wmnet [production]
11:08 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw2001.wikimedia.org [production]
11:08 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw1001.wikimedia.org [production]
11:04 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-rw2001.wikimedia.org [production]
11:04 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ldap-rw1001.wikimedia.org [production]
11:03 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon1003.wikimedia.org [production]
11:00 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts testvm2005.codfw.wmnet [production]
11:00 <jmm@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:00 <jmm@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: testvm2005.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" [production]
10:59 <jmm@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: testvm2005.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" [production]
10:57 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host netmon1003.wikimedia.org [production]
10:57 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon2002.wikimedia.org [production]
10:55 <jmm@cumin2003> START - Cookbook sre.dns.netbox [production]
10:51 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host netmon2002.wikimedia.org [production]
10:51 <aokoth@cumin1003> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Security Release - T431656 [production]
10:50 <jmm@cumin2003> START - Cookbook sre.hosts.decommission for hosts testvm2005.codfw.wmnet [production]
10:41 <aokoth@cumin1003> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Security Release - T431656 [production]
10:40 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.host-bgp (exit_code=0) for host ml-serve1003 [production]
10:40 <cmooney@cumin1003> START - Cookbook sre.network.host-bgp for host ml-serve1003 [production]
10:39 <aokoth@cumin1003> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Security Release - T431656 [production]
10:38 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2033.codfw.wmnet [production]
10:37 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install2005.wikimedia.org [production]
10:37 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install1005.wikimedia.org [production]
10:35 <klausman@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-serve1004.eqiad.wmnet with OS bookworm [production]
10:31 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host install1005.wikimedia.org [production]