751-800 of 10000 results (82ms)
2025-06-24 ยง
14:35 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd2006-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:35 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd2007-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:35 <jhancock@cumin1003> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd2005-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:34 <dreamyjazz@deploy1003> Started scap sync-world: Backport for [[gerrit:1163378|Fix broken German translation causing message to not render]] [production]
14:32 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2044.codfw.wmnet [production]
14:31 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1049.eqiad.wmnet [production]
14:31 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.15 [production]
14:31 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.14 [production]
14:29 <swfrench@dns1004> END - running authdns-update [production]
14:29 <jiji@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
14:28 <jiji@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
14:28 <swfrench@dns1004> START - running authdns-update [production]
14:27 <jiji@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
14:27 <ejegg> standalone (IPN listener) SmashPig upgraded from 4eef974d to bc4ad04d [production]
14:27 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd2007-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:26 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd2006-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:26 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc2044.codfw.wmnet [production]
14:26 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply [production]
14:26 <jhancock@cumin1003> START - Cookbook sre.hosts.provision for host cloudcephosd2005-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
14:26 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mobileapps: apply [production]
14:26 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd2007-dev [production]
14:26 <jhancock@cumin1003> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd2005-dev [production]
14:26 <jhancock@cumin1003> END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host cloudcephosd2006-dev [production]
14:26 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd2007-dev [production]
14:26 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd2006-dev [production]
14:26 <jhancock@cumin1003> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd2005-dev [production]
14:25 <jhancock@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:25 <jhancock@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudcephosd2005-dev to codfw - jhancock@cumin1003" [production]
14:25 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc1049.eqiad.wmnet [production]
14:25 <jhancock@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudcephosd2005-dev to codfw - jhancock@cumin1003" [production]
14:25 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.14 [production]
14:25 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.13 [production]
14:25 <cmooney@cumin1003> END (FAIL) - Cookbook sre.dns.netbox_records (exit_code=99) Generate and push DNS records from Netbox data [production]
14:25 <jiji@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
14:23 <cmooney@cumin1003> START - Cookbook sre.dns.netbox_records Generate and push DNS records from Netbox data [production]
14:23 <cmooney@cumin1003> END (FAIL) - Cookbook sre.dns.netbox_records (exit_code=99) Generate and push DNS records from Netbox data [production]
14:23 <cmooney@cumin1003> START - Cookbook sre.dns.netbox_records Generate and push DNS records from Netbox data [production]
14:22 <jhancock@cumin1003> START - Cookbook sre.dns.netbox [production]
14:22 <cmooney@cumin1003> END (FAIL) - Cookbook sre.dns.netbox_records (exit_code=99) Generate and push DNS records from Netbox data [production]
14:22 <cmooney@cumin1003> START - Cookbook sre.dns.netbox_records Generate and push DNS records from Netbox data [production]
14:22 <stevemunene@cumin1002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-worker1176.eqiad.wmnet with OS bullseye [production]
14:21 <cmooney@cumin1003> END (FAIL) - Cookbook sre.dns.netbox_records (exit_code=99) Generate and push DNS records from Netbox data [production]
14:21 <cmooney@cumin1003> START - Cookbook sre.dns.netbox_records Generate and push DNS records from Netbox data [production]
14:20 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.13 [production]
14:20 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.12 [production]
14:16 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/mobileapps: apply [production]
14:15 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/mobileapps: apply [production]
14:14 <mvernon@cumin1002> START - Cookbook sre.swift.check-dbs Checking container DBs of wikipedia-commons-local-thumb.12 [production]
14:14 <mvernon@cumin1002> END (PASS) - Cookbook sre.swift.check-dbs (exit_code=0) Checking container DBs of wikipedia-commons-local-thumb.11 [production]
14:08 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2043.codfw.wmnet [production]