251-300 of 10000 results (93ms)
2025-05-16 §
03:01 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1077.eqiad.wmnet with reason: host reimage [production]
02:58 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1077.eqiad.wmnet with reason: host reimage [production]
02:55 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cirrussearch1076.eqiad.wmnet with reason: host reimage [production]
02:51 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cirrussearch1076.eqiad.wmnet with reason: host reimage [production]
02:44 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1077 [production]
02:44 <ryankemper@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1077 [production]
02:43 <ryankemper@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1077.eqiad.wmnet with OS bullseye [production]
02:37 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1076 [production]
02:37 <ryankemper@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1076 [production]
02:37 <ryankemper@cumin2002> START - Cookbook sre.hosts.reimage for host cirrussearch1076.eqiad.wmnet with OS bullseye [production]
02:34 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from elastic1077 to cirrussearch1077 [production]
02:34 <ryankemper@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cirrussearch1077 [production]
02:32 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from elastic1076 to cirrussearch1076 [production]
02:32 <ryankemper@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cirrussearch1076 [production]
02:32 <ryankemper@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cirrussearch1077 [production]
02:32 <ryankemper@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1077 on all recursors [production]
02:32 <ryankemper@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1077 on all recursors [production]
02:31 <ryankemper@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
02:30 <ryankemper@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cirrussearch1076 [production]
02:30 <ryankemper@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cirrussearch1076 on all recursors [production]
02:30 <ryankemper@cumin2002> START - Cookbook sre.dns.wipe-cache cirrussearch1076 on all recursors [production]
02:30 <ryankemper@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
02:30 <ryankemper@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1076 to cirrussearch1076 - ryankemper@cumin2002" [production]
02:30 <ryankemper@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming elastic1076 to cirrussearch1076 - ryankemper@cumin2002" [production]
02:29 <ryankemper@cumin2002> START - Cookbook sre.dns.netbox [production]
02:23 <ryankemper@cumin2002> START - Cookbook sre.dns.netbox [production]
02:23 <ryankemper@cumin2002> START - Cookbook sre.hosts.rename from elastic1077 to cirrussearch1077 [production]
02:23 <ryankemper@cumin2002> START - Cookbook sre.hosts.rename from elastic1076 to cirrussearch1076 [production]
01:27 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2002.codfw.wmnet with OS bullseye [production]
01:16 <brett> Restarting tomcat10 on idp1004 [production]
01:06 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp3066.* [production]
01:04 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp3074.* [production]
00:49 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp5031.* [production]
00:48 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp5031 [production]
00:18 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
00:15 <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
2025-05-15 §
23:59 <eevans@cumin1002> START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bullseye [production]
22:27 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp503[1-2].eqsin.wmnet} and A:cp - <bound method SREBatchRunnerBase._reason of <cookbooks.sre.cdn.roll-upgrade-varnish.RollUpgradeVarnishRunner object at 0x7f818c5f7df0>> [production]
22:27 <cjming@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic: apply [production]
22:23 <cjming@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic: apply [production]
22:11 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text_eqsin - <bound method SREBatchRunnerBase._reason of <cookbooks.sre.cdn.roll-upgrade-varnish.RollUpgradeVarnishRunner object at 0x7f87783bdac0>> [production]
22:00 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2002.codfw.wmnet with OS bullseye [production]
21:55 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp503[1-2].eqsin.wmnet} and A:cp - <bound method SREBatchRunnerBase._reason of <cookbooks.sre.cdn.roll-upgrade-varnish.RollUpgradeVarnishRunner object at 0x7f818c5f7df0>> [production]
21:40 <brett@cumin2002> END (FAIL) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=1) rolling upgrade of Varnish on A:cp-upload_eqsin - <bound method SREBatchRunnerBase._reason of <cookbooks.sre.cdn.roll-upgrade-varnish.RollUpgradeVarnishRunner object at 0x7fc4014eef10>> [production]
21:35 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
21:34 <dancy@deploy1003> Installation of scap version "4.169.0" completed for 2 hosts [production]
21:32 <dancy@deploy1003> Installing scap version "4.169.0" for 2 host(s) [production]
21:31 <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage [production]
21:20 <cjming@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic-next: apply [production]
21:19 <jdrewniak@deploy1003> Finished scap sync-world: Backport for [[gerrit:1146726|styles: Set override also to former value of `line-height-small` token (T389900 T394305)]] (duration: 18m 45s) [production]