301-350 of 10000 results (147ms)
2026-08-13 ยง
12:19 <cgoubert@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
12:18 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host moss-be1003.eqiad.wmnet [production]
12:17 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host netflow6001.drmrs.wmnet [production]
12:17 <moritzm> installin curl security updates [production]
12:15 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
12:15 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1233.eqiad.wmnet with OS bookworm [production]
12:15 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1210.eqiad.wmnet with OS bookworm [production]
12:15 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1211.eqiad.wmnet with OS bookworm [production]
12:13 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti1049.eqiad.wmnet [production]
12:13 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netflow7002.magru.wmnet [production]
12:12 <btullis@cumin1003> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1178.eqiad.wmnet with OS bookworm [production]
12:10 <mvernon@cumin2003> START - Cookbook sre.hosts.reboot-single for host moss-be1003.eqiad.wmnet [production]
12:10 <cgoubert@cumin2003> START - Cookbook sre.dns.netbox [production]
12:10 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apus-be1006.eqiad.wmnet [production]
12:10 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) rdb-lock2003.codfw.wmnet on all recursors [production]
12:10 <cgoubert@cumin2003> START - Cookbook sre.dns.wipe-cache rdb-lock2003.codfw.wmnet on all recursors [production]
12:10 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:10 <cgoubert@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
12:10 <cgoubert@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
12:09 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host netflow7002.magru.wmnet [production]
12:08 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1049.eqiad.wmnet [production]
12:05 <cgoubert@cumin2003> START - Cookbook sre.dns.netbox [production]
12:05 <cgoubert@cumin2003> START - Cookbook sre.ganeti.makevm for new host rdb-lock2003.codfw.wmnet [production]
12:04 <jayme@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'sync'. [production]
12:04 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
12:03 <mvernon@cumin2003> START - Cookbook sre.hosts.reboot-single for host apus-be1006.eqiad.wmnet [production]
12:02 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apus-be1005.eqiad.wmnet [production]
12:01 <jmm@cumin2003> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1038.eqiad.wmnet [production]
12:01 <jmm@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1038.eqiad.wmnet [production]
12:01 <cmooney@cumin1003> START - Cookbook sre.dns.netbox [production]
11:58 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1213.eqiad.wmnet with OS bookworm [production]
11:56 <mvernon@cumin2003> START - Cookbook sre.hosts.reboot-single for host apus-be1005.eqiad.wmnet [production]
11:55 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apus-be1004.eqiad.wmnet [production]
11:54 <cgoubert@cumin2003> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) for new host rdb-lock2003.codfw.wmnet [production]
11:54 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) rdb-lock2003.codfw.wmnet on all recursors [production]
11:53 <cgoubert@cumin2003> START - Cookbook sre.dns.wipe-cache rdb-lock2003.codfw.wmnet on all recursors [production]
11:53 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:53 <cgoubert@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
11:53 <cgoubert@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
11:53 <jmm@cumin2003> START - Cookbook sre.hosts.reboot-single for host ganeti1038.eqiad.wmnet [production]
11:49 <mvernon@cumin2003> START - Cookbook sre.hosts.reboot-single for host apus-be1004.eqiad.wmnet [production]
11:44 <kevinbazira@deploy1003> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
11:44 <moritzm> installing Linux 5.10.262 on Bullseye hosts [production]
11:41 <jmm@cumin2003> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1038.eqiad.wmnet [production]
11:40 <cgoubert@cumin2003> START - Cookbook sre.dns.netbox [production]
11:40 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) rdb-lock2003.codfw.wmnet on all recursors [production]
11:40 <cgoubert@cumin2003> START - Cookbook sre.dns.wipe-cache rdb-lock2003.codfw.wmnet on all recursors [production]
11:40 <cgoubert@cumin2003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
11:40 <cgoubert@cumin2003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]
11:40 <cgoubert@cumin2003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM rdb-lock2003.codfw.wmnet - cgoubert@cumin2003" [production]