151-200 of 10000 results (1ms)
2026-08-24 ยง
16:06 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:06 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:04 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
16:04 <fceratto@cumin1003> START - Cookbook sre.ganeti.makevm for new host db2901.codfw.wmnet [production]
16:03 <mpostoronca@deploy1003> dreamyjazz, mpostoronca: Continuing with deployment [production]
16:00 <bking@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm [production]
16:00 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:59 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:59 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1080.eqiad.wmnet' (T435537) [admin]
15:59 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:59 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:58 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:58 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:57 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:57 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:56 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:55 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:54 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:54 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:54 <mpostoronca@deploy1003> dreamyjazz, mpostoronca: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:54 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm [production]
15:53 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:53 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:53 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <mpostoronca@deploy1003> Started scap sync-world: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] [production]
15:52 <bking@cumin2003> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:45 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:44 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:42 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:42 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:41 <ladsgroup@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
15:41 <ladsgroup@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
15:36 <mvernon@cumin1003> END (PASS) - Cookbook sre.swift.remove-ghost-objects (exit_code=0) from container wikipedia-commons-local-public.c7 in eqiad [production]
15:35 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:35 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1080.eqiad.wmnet' (T435537) [admin]
15:34 <mvernon@cumin1003> START - Cookbook sre.swift.remove-ghost-objects from container wikipedia-commons-local-public.c7 in eqiad [production]
15:29 <bking@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm [production]
15:24 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm [production]
15:23 <bking@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm [production]
15:18 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm [production]
15:11 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply [production]
15:10 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply [production]
15:10 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply [production]