251-300 of 10000 results (72ms)
2026-08-24 ยง
16:10 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:10 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:07 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:07 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:07 <mpostoronca@deploy1003> Finished scap sync-world: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] (duration: 15m 08s) [production]
16:06 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:06 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:06 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:06 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:05 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:04 <fceratto@cumin1003> START - Cookbook sre.dns.netbox [production]
16:04 <fceratto@cumin1003> START - Cookbook sre.ganeti.makevm for new host db2901.codfw.wmnet [production]
16:03 <mpostoronca@deploy1003> dreamyjazz, mpostoronca: Continuing with deployment [production]
16:00 <bking@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm [production]
16:00 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:59 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:59 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:59 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:58 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:58 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:57 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:57 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:56 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:55 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:54 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:54 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:54 <mpostoronca@deploy1003> dreamyjazz, mpostoronca: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
15:54 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm [production]
15:53 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:53 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:53 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:52 <mpostoronca@deploy1003> Started scap sync-world: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] [production]
15:52 <bking@cumin2003> END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:45 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:44 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
15:42 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:42 <bking@cumin2003> END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:41 <ladsgroup@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
15:41 <ladsgroup@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
15:36 <mvernon@cumin1003> END (PASS) - Cookbook sre.swift.remove-ghost-objects (exit_code=0) from container wikipedia-commons-local-public.c7 in eqiad [production]
15:35 <bking@cumin2003> START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] [production]
15:34 <mvernon@cumin1003> START - Cookbook sre.swift.remove-ghost-objects from container wikipedia-commons-local-public.c7 in eqiad [production]
15:29 <bking@cumin2003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm [production]
15:24 <bking@cumin2003> START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm [production]