1101-1150 of 10000 results (38ms)
2025-06-24 ยง
10:33 <fabfur@cumin1002> END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Fix previous release - fabfur@cumin1002 - T396621" [production]
10:33 <fabfur@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix previous release - fabfur@cumin1002 - T396621 [production]
10:32 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2039.codfw.wmnet [production]
10:32 <fabfur@cumin1002> START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Fix previous release - fabfur@cumin1002 - T396621 [production]
10:32 <fabfur@cumin1002> START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Fix previous release - fabfur@cumin1002 - T396621" [production]
10:31 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/push-notifications: apply [production]
10:31 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox-snippets (exit_code=0) [production]
10:31 <cmooney@cumin1003> START - Cookbook sre.dns.netbox-snippets [production]
10:31 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/push-notifications: apply [production]
10:30 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc2039.codfw.wmnet [production]
10:30 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
10:30 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
10:30 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
10:29 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc1053.eqiad.wmnet [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifeeds: apply [production]
10:29 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs3009.esams.wmnet [production]
10:29 <vgutierrez@cumin1002> START - Cookbook sre.hosts.remove-downtime for lvs3009.esams.wmnet [production]
10:29 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/wikifeeds: apply [production]
10:23 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf1002.eqiad.wmnet [production]
10:23 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf2002.codfw.wmnet [production]
10:22 <hnowlan@deploy1003> helmfile [eqiad] DONE helmfile.d/services/changeprop: apply [production]
10:21 <hnowlan@deploy1003> helmfile [eqiad] START helmfile.d/services/changeprop: apply [production]
10:20 <hnowlan@deploy1003> helmfile [codfw] DONE helmfile.d/services/changeprop: apply [production]
10:19 <hnowlan@deploy1003> helmfile [codfw] START helmfile.d/services/changeprop: apply [production]
10:18 <vgutierrez@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on lvs3009.esams.wmnet with reason: switching to katran [production]
10:18 <hnowlan@deploy1003> helmfile [staging] DONE helmfile.d/services/changeprop: apply [production]
10:18 <hnowlan@deploy1003> helmfile [staging] START helmfile.d/services/changeprop: apply [production]
10:18 <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs3009.esams.wmnet} and A:liberica (T396561) [production]
10:18 <Amir1> dropping searchindex table everywhere (T397367) [production]
10:18 <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.admin depooling P{lvs3009.esams.wmnet} and A:liberica (T396561) [production]
10:17 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf1002.eqiad.wmnet [production]
10:17 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf2002.codfw.wmnet [production]
10:17 <jgiannelos@deploy1003> helmfile [staging] DONE helmfile.d/services/mobileapps: apply [production]
10:15 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf2001.codfw.wmnet [production]
10:15 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf1001.eqiad.wmnet [production]
10:14 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc1054.eqiad.wmnet [production]
10:09 <jiji@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc2038.codfw.wmnet [production]
10:09 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf2001.codfw.wmnet [production]
10:09 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc-wf1001.eqiad.wmnet [production]
10:08 <jgiannelos@deploy1003> helmfile [staging] START helmfile.d/services/mobileapps: apply [production]
10:08 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc1054.eqiad.wmnet [production]
10:07 <jiji@cumin1003> START - Cookbook sre.hosts.reboot-single for host mc2038.codfw.wmnet [production]
10:06 <akosiaris@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aux-k8s-worker1007.eqiad.wmnet with OS bookworm [production]
10:04 <taavi@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logging [toolsbeta]
10:04 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component logging [toolsbeta]
10:04 <fabfur> cp700[1-2] depooled to test new hiddenparma rules syntax (T396621) [production]