1001-1050 of 10000 results (27ms)
2023-08-15 ยง
15:49 <sukhe@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - sukhe@cumin2002" [production]
15:49 <robh@cumin1001> START - Cookbook sre.hosts.provision for host lvs3010.mgmt.esams.wmnet with reboot policy FORCED [production]
15:44 <robh@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:44 <robh@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: dns3004 - robh@cumin1001" [production]
15:44 <bking@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1015.eqiad.wmnet with OS bullseye [production]
15:44 <robh@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: dns3004 - robh@cumin1001" [production]
15:42 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
15:42 <wm-bot2> Restarting openstack services on cloudservices2004-dev: ['designate-mdns', 'designate-sink', 'designate-central', 'designate-producer', 'designate-worker', 'designate-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:42 <wm-bot2> Restarting openstack services on cloudservices2005-dev: ['designate-central', 'designate-sink', 'designate-worker', 'designate-producer', 'designate-mdns', 'designate-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:42 <wm-bot2> Restarting openstack services on cloudnet2005-dev: ['neutron-metadata-agent', 'neutron-dhcp-agent', 'neutron-linuxbridge-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:42 <wm-bot2> Restarting openstack services on cloudnet2006-dev: ['neutron-dhcp-agent', 'neutron-metadata-agent', 'neutron-linuxbridge-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:42 <wm-bot2> Restarting openstack services on cloudbackup1002-dev: ['cinder-backup'] - cookbook ran by root@cloudcumin1001 [admin]
15:42 <robh@cumin1001> START - Cookbook sre.dns.netbox [production]
15:42 <wm-bot2> Restarting openstack services on cloudbackup1001-dev: ['cinder-backup'] - cookbook ran by root@cloudcumin1001 [admin]
15:41 <wm-bot2> Restarting openstack services on cloudcontrol2005-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-volume', 'cinder-scheduler', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by root@cloudcumin1001 [admin]
15:41 <wm-bot2> Restarting openstack services on cloudvirt2003-dev: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:41 <bking@cumin1001> START - Cookbook sre.hosts.reimage for host flink-zk2001.codfw.wmnet with OS bookworm [production]
15:41 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk2001.codfw.wmnet - bking@cumin1001" [production]
15:41 <wm-bot2> Restarting openstack services on cloudvirt2002-dev: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:40 <wm-bot2> Restarting openstack services on cloudvirt2001-dev: ['nova-compute', 'neutron-linuxbridge-agent'] - cookbook ran by root@cloudcumin1001 [admin]
15:40 <wm-bot2> Restarting openstack services on cloudcontrol2004-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by root@cloudcumin1001 [admin]
15:40 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM flink-zk2001.codfw.wmnet - bking@cumin1001" [production]
15:40 <wm-bot2> Restarting openstack services on cloudcontrol2001-dev: ['nova-conductor', 'nova-scheduler', 'nova-api', 'nova-api-metadata', 'cinder-scheduler', 'cinder-volume', 'neutron-api', 'neutron-rpc-server', 'trove-api', 'trove-conductor', 'trove-taskmanager', 'keystone', 'keystone-admin', 'glance-api', 'magnum-api', 'magnum-conductor', 'heat-api', 'heat-api-cfn', 'heat-engine'] - cookbook ran by root@cloudcumin1001 [admin]
15:40 <bking@cumin1001> END (FAIL) - Cookbook sre.dns.wipe-cache (exit_code=99) flink-zk2001.codfw.wmnet on all recursors [production]
15:40 <bking@cumin1001> START - Cookbook sre.dns.wipe-cache flink-zk2001.codfw.wmnet on all recursors [production]
15:40 <bking@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:40 <bking@cumin1001> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk2001.codfw.wmnet - bking@cumin1001" [production]
15:40 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3066 [production]
15:40 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
15:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti3007.esams.wmnet [production]
15:39 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3066 [production]
15:39 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3068 [production]
15:39 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3068 [production]
15:39 <bking@cumin1001> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM flink-zk2001.codfw.wmnet - bking@cumin1001" [production]
15:39 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3070 [production]
15:39 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3070 [production]
15:38 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3072 [production]
15:38 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3072 [production]
15:38 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3074 [production]
15:38 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3074 [production]
15:38 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3076 [production]
15:38 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3076 [production]
15:38 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3078 [production]
15:37 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3078 [production]
15:37 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dns3004 [production]
15:37 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host dns3004 [production]
15:37 <robh@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp3080 [production]
15:37 <robh@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cp3080 [production]
15:36 <bking@cumin1001> START - Cookbook sre.dns.netbox [production]
15:36 <bking@cumin1001> START - Cookbook sre.ganeti.makevm for new host flink-zk2001.codfw.wmnet [production]