151-200 of 10000 results (29ms)
2025-05-22 ยง
17:31 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1040'] [cloudvirt-canary]
17:30 <gmodena@deploy1003> helmfile [staging] START helmfile.d/services/eventgate-analytics: sync [production]
17:30 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1040'] [cloudvirt-canary]
17:27 <swfrench@deploy1003> Stopping before sync operations [production]
17:26 <swfrench@deploy1003> Started scap sync-world: Non-deploy scap run to stop building and publishing PHP 7.4 images - T391057 [production]
17:25 <bd808> `./jjb-update 'selenium-daily-beta*-MediaWiki'` to deploy updates to selenium-daily-beta-MediaWiki and selenium-daily-betacommons-MediaWiki failure notifications (T394551) [releng]
17:25 <dani@deploy1003> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
17:24 <dani@deploy1003> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
17:24 <dani@deploy1003> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
17:24 <dani@deploy1003> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
17:24 <dani@deploy1003> helmfile [staging] DONE helmfile.d/services/miscweb: apply [production]
17:24 <dani@deploy1003> helmfile [staging] START helmfile.d/services/miscweb: apply [production]
17:23 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
17:23 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
17:17 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
17:16 <bking@cumin2002> END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cirrussearch1103.eqiad.wmnet with OS bullseye [production]
17:15 <swfrench@deploy1003> Stopping before sync operations [production]
17:14 <swfrench@deploy1003> Started scap sync-world: Non-deploy scap run to pick up mw-script / mw-cron logging changes - T378479 [production]
17:11 <cgoubert@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
17:08 <cgoubert@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
17:07 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
17:06 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
17:05 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
17:05 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
17:03 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
17:02 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
16:57 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
16:56 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
16:53 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
16:46 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
16:36 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
16:32 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
16:29 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate True, for hosts list: ['cloudvirt1041'] [cloudvirt-canary]
16:28 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate True, for hosts list: ['cloudvirt1041'] [cloudvirt-canary]
16:28 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate False, for hosts list: ['cloudvirt1041'] [cloudvirt-canary]
16:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1041'] [cloudvirt-canary]
16:26 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:25 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:23 <volans@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cirrussearch2110.codfw.wmnet [production]
16:23 <volans@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cirrussearch2110.codfw.wmnet [production]
16:22 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
16:22 <btullis@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub: sync on production [production]
16:15 <btullis@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub: apply on production [production]
16:12 <volans@cumin1003> START - Cookbook sre.hosts.reboot-single for host cirrussearch2110.codfw.wmnet [production]
16:08 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cirrussearch1062.eqiad.wmnet with OS bullseye [production]
16:08 <volans@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cirrussearch2110.codfw.wmnet [production]
15:59 <volans@cumin1003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=1) upgrade firmware for hosts cirrussearch2110.codfw.wmnet [production]
15:58 <volans@cumin1003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cirrussearch2110.codfw.wmnet [production]
15:56 <bking@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cirrussearch1103 [production]
15:56 <bking@cumin2002> START - Cookbook sre.hosts.move-vlan for host cirrussearch1103 [production]