1-50 of 10000 results (37ms)
2025-05-24 §
21:52 <Krinkle> Disable publishing notifs on Phab tasks from extension-Chart mirror, T143162, T272803 [releng]
12:57 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-65 [tools]
12:50 <andrew@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-65 [tools]
11:40 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'betorov' in role 'reader' [bastion]
11:39 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'betorov' in role 'reader' [bastion]
05:40 <JJMC89> copypatrol-backend-prod-01 deploy 3c28ef5..60a68f3 [copypatrol]
00:58 <sbassett> Ran scap remove-patch for the first 4 security patches for T392341 (the 5th patch is still pending a merge in gerrit) [production]
2025-05-23 §
23:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host apus-be2004.codfw.wmnet with OS bookworm [production]
23:01 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
22:55 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jhancock@cumin2002" [production]
22:37 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on apus-be2004.codfw.wmnet with reason: host reimage [production]
22:34 <jhancock@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on apus-be2004.codfw.wmnet with reason: host reimage [production]
22:07 <bking@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on cirrussearch[2110-2111].codfw.wmnet with reason: firmware update [production]
21:58 <jhancock@cumin2002> START - Cookbook sre.hosts.reimage for host apus-be2004.codfw.wmnet with OS bookworm [production]
21:56 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: cirrussearch2110*,cirrussearch2111* for T394543 - bking@cumin2002 [production]
21:56 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: cirrussearch2110*,cirrussearch2111* for T394543 - bking@cumin2002 [production]
21:49 <jhancock@cumin2002> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host apus-be2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:30 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1107.eqiad.wmnet with OS bullseye [production]
21:16 <jhancock@cumin2002> START - Cookbook sre.hosts.provision for host apus-be2004.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
21:03 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1107.eqiad.wmnet with reason: host reimage [production]
20:59 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1107.eqiad.wmnet with reason: host reimage [production]
20:44 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1102.eqiad.wmnet with OS bullseye [production]
20:43 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1107 [production]
20:43 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1107 [production]
20:43 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1107.eqiad.wmnet with OS bullseye [production]
20:37 <bking@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1107.eqiad.wmnet on all recursors [production]
20:37 <bking@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1107.eqiad.wmnet on all recursors [production]
20:37 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cirrussearch1107.eqiad.wmnet with OS bullseye [production]
20:30 <Krinkle> Shut off cvn-apache10, T395164 [cvn]
20:29 <Krinkle> Change cvn.wmcloud.org web proxy from cvn-apache10 to cvn-apache11, T395164 [cvn]
20:22 <Krinkle> Change cvn.wmflabs.org web proxy from cvn-apache10 to cvn-apache11, T395164 [cvn]
20:18 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1102.eqiad.wmnet with reason: host reimage [production]
20:17 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1107 [production]
20:17 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1107 [production]
20:17 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1107.eqiad.wmnet with OS bullseye [production]
20:15 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from elastic1107 to cirrussearch1107 [production]
20:15 <bking@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cirrussearch1107 [production]
20:15 <bking@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cirrussearch1107 [production]
20:15 <bking@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1107 on all recursors [production]
20:15 <bking@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1107 on all recursors [production]
20:15 <bking@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
20:15 <bking@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1107 to cirrussearch1107 - bking@cumin2002" [production]
20:14 <bking@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1102.eqiad.wmnet with reason: host reimage [production]
20:13 <bking@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1107 to cirrussearch1107 - bking@cumin2002" [production]
20:10 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1101.eqiad.wmnet with OS bullseye [production]
20:09 <bking@cumin2002> START - Cookbook sre.dns.netbox [production]
20:09 <bking@cumin2002> START - Cookbook sre.hosts.rename from elastic1107 to cirrussearch1107 [production]
20:00 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1102 [production]
20:00 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1102 [production]
20:00 <bking@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1102.eqiad.wmnet with OS bullseye [production]