3201-3250 of 10000 results (102ms)
2023-07-18 ยง
17:29 <robh@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016 relocation - robh@cumin1001" [production]
17:27 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
17:25 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host flink-zk1002.eqiad.wmnet with OS bookworm [production]
17:21 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk1002.eqiad.wmnet - bking@cumin1001" [production]
17:20 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk1002.eqiad.wmnet - bking@cumin1001" [production]
17:19 <bking@cumin1001> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) flink-zk1002.eqiad.wmnet on all recursors [production]
17:19 <bking@cumin1001> START - Cookbook sre.dns.wipe-cache flink-zk1002.eqiad.wmnet on all recursors [production]
17:19 <bking@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:19 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk1002.eqiad.wmnet - bking@cumin1001" [production]
17:19 <sukhe@cumin2002> END (PASS) - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns (exit_code=0) rolling reboot on A:wikidough-drmrs and A:wikidough [production]
17:19 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk1002.eqiad.wmnet - bking@cumin1001" [production]
17:16 <bking@cumin1001> START - Cookbook sre.dns.netbox [production]
17:16 <bking@cumin1001> START - Cookbook sre.ganeti.makevm for new host flink-zk1002.eqiad.wmnet [production]
17:07 <jelto@cumin1001> START - Cookbook sre.gitlab.reboot-runner rolling reboot on A:gitlab-runner [production]
17:04 <sukhe@cumin2002> START - Cookbook sre.dns.roll-restart-reboot-wikimedia-dns rolling reboot on A:wikidough-drmrs and A:wikidough [production]
17:02 <dancy@deploy1002> Installation of scap version "4.55.0" completed for 605 hosts [production]
17:01 <dancy@deploy1002> Installing scap version "4.55.0" for 605 hosts [production]
16:33 <dancy@deploy1002> Pruned MediaWiki: 1.41.0-wmf.16 (duration: 02m 11s) [production]
16:30 <dancy@deploy1002> Finished scap: testwikis wikis to 1.41.0-wmf.18 refs T340246 (duration: 46m 15s) [production]
16:28 <elukey> maintenance finished for kafka main-codfw [production]
16:24 <btullis@cumin1001> START - Cookbook sre.hosts.reimage for host analytics1075.eqiad.wmnet with OS bullseye [production]
16:03 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs1015 [production]
16:03 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host lvs1015 [production]
16:03 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs1014 [production]
16:03 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:03 <robh@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs10145 relocation - robh@cumin1001" [production]
16:03 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host lvs1014 [production]
16:02 <robh@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs10145 relocation - robh@cumin1001" [production]
16:01 <robh@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs1013.eqiad.wmnet with OS bullseye [production]
16:00 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
15:44 <dancy@deploy1002> Started scap: testwikis wikis to 1.41.0-wmf.18 refs T340246 [production]
15:31 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts lvs1016.eqiad.wmnet [production]
15:31 <fabfur@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:31 <fabfur@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fabfur@cumin1001" [production]
15:31 <fabfur@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1016.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fabfur@cumin1001" [production]
15:28 <fabfur@cumin1001> START - Cookbook sre.dns.netbox [production]
15:23 <fabfur@cumin1001> START - Cookbook sre.hosts.decommission for hosts lvs1016.eqiad.wmnet [production]
15:22 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host lvs1013.eqiad.wmnet with OS bullseye [production]
15:21 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs1013 [production]
15:21 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host lvs1013 [production]
15:20 <robh@cumin1001> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs1013.eqiad.wmnet with OS bullseye [production]
15:18 <robh@cumin1001> START - Cookbook sre.hosts.reimage for host lvs1013.eqiad.wmnet with OS bullseye [production]
15:08 <robh@cumin1001> END (ERROR) - Cookbook sre.hosts.provision (exit_code=97) for host lvs1013.mgmt.eqiad.wmnet with reboot policy FORCED [production]
15:02 <fabfur@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts lvs1015.eqiad.wmnet [production]
15:02 <fabfur@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:01 <fabfur@cumin1001> START - Cookbook sre.dns.netbox [production]
15:00 <robh@cumin1001> START - Cookbook sre.hosts.provision for host lvs1013.mgmt.eqiad.wmnet with reboot policy FORCED [production]
14:57 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:57 <robh@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1013 relocation - robh@cumin1001" [production]
14:56 <robh@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: lvs1013 relocation - robh@cumin1001" [production]