101-150 of 10000 results (108ms)
2026-05-06 ยง
18:37 <dzahn@dns1005> END - running authdns-update [production]
18:35 <dzahn@dns1005> START - running authdns-update [production]
18:32 <brennen> 1.47.0-wmf.1 train status (T423910): blockers resolved, rolling to group1 [production]
18:31 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host cp4050.ulsfo.wmnet with OS trixie [production]
18:29 <sukhe@cumin1003> START - Cookbook sre.hosts.reimage for host lvs4010.ulsfo.wmnet with OS bookworm [production]
18:02 <cmooney@cumin1003> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device asw1-23-ulsfo [production]
18:01 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device asw1-23-ulsfo [production]
17:59 <bking@cumin2002> END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: restart to test fixes from T425301 - bking@cumin2002 [production]
17:55 <cmooney@cumin1003> END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device asw1-23-ulsfo [production]
17:55 <cmooney@cumin1003> START - Cookbook sre.network.tls for network device asw1-23-ulsfo [production]
17:37 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply [production]
17:36 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-video: apply [production]
17:36 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:35 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply [production]
17:35 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:34 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:34 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
17:34 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
17:33 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:32 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
17:32 <swfrench@deploy1003> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
17:31 <swfrench@deploy1003> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
17:28 <topranks> rebooting asw1-23-ulsfo to upgrade SR-Linux OS on switch T408892 [production]
17:27 <cmooney@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on asw1-23-ulsfo,asw1-23-ulsfo IPv6 with reason: upgrading sr-linux on asw1-23-ulsfo [production]
17:20 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply [production]
17:18 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-video: apply [production]
17:18 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:18 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply [production]
17:17 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:17 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:16 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply [production]
17:16 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-media: apply [production]
17:15 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:15 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply [production]
17:14 <swfrench@deploy1003> helmfile [codfw] DONE helmfile.d/services/shellbox: apply [production]
17:14 <swfrench@deploy1003> helmfile [codfw] START helmfile.d/services/shellbox: apply [production]
17:08 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox-video: apply [production]
17:08 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox-video: apply [production]
17:08 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox-timeline: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
17:07 <swfrench@deploy1003> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
17:06 <swfrench@deploy1003> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
17:02 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on 39 hosts with reason: ulsfo depooled for switch work [production]
16:53 <cmooney@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on asw1-22-ulsfo,asw1-22-ulsfo IPv6 with reason: upgrading sr-linux on asw1-23-ulsfo [production]