6301-6350 of 10000 results (92ms)
2023-05-01 ยง
22:17 <legoktm@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
22:17 <legoktm@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply [production]
22:16 <legoktm@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-media: apply [production]
22:16 <legoktm@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply [production]
22:16 <legoktm@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply [production]
22:15 <legoktm@deploy1002> helmfile [eqiad] DONE helmfile.d/services/shellbox: apply [production]
22:14 <legoktm@deploy1002> helmfile [eqiad] START helmfile.d/services/shellbox: apply [production]
21:57 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply [production]
21:56 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-timeline: apply [production]
21:56 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply [production]
21:56 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply [production]
21:56 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-media: apply [production]
21:56 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-media: apply [production]
21:55 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
21:55 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
21:55 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
21:55 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
21:47 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply [production]
21:47 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox-constraints: apply [production]
21:47 <legoktm@deploy1002> helmfile [staging] DONE helmfile.d/services/shellbox: apply [production]
21:47 <legoktm@deploy1002> helmfile [staging] START helmfile.d/services/shellbox: apply [production]
21:15 <ryankemper@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on 17 hosts with reason: T334049 maint [production]
21:15 <ryankemper@cumin2002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on 17 hosts with reason: T334049 maint [production]
21:08 <bking@cumin1001> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: elastic[2045-2048,2059,2065-2066,2071,2081-2083]* for row C switch upgrade - bking@cumin1001 - T334049 [production]
21:08 <bking@cumin1001> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic[2045-2048,2059,2065-2066,2071,2081-2083]* for row C switch upgrade - bking@cumin1001 - T334049 [production]
21:08 <bking@cumin1001> END (FAIL) - Cookbook sre.elasticsearch.ban (exit_code=99) Banning hosts: elastic[2045-2048,2059,2065-2066,2071,2081-2083] for row C switch upgrade - bking@cumin1001 - T334049 [production]
21:08 <bking@cumin1001> START - Cookbook sre.elasticsearch.ban Banning hosts: elastic[2045-2048,2059,2065-2066,2071,2081-2083] for row C switch upgrade - bking@cumin1001 - T334049 [production]
21:02 <eevans@cumin1001> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) pool sessionstore in eqiad: maintenance [production]
20:57 <eevans@cumin1001> START - Cookbook sre.discovery.service-route pool sessionstore in eqiad: maintenance [production]
20:47 <urandom> upgrading sessionstore1003 to Cassandra 3.11.14 โ€” T335383 [production]
20:45 <urandom> upgrading sessionstore1002 to Cassandra 3.11.14 โ€” T335383 [production]
20:42 <urandom> upgrading sessionstore1001 to Cassandra 3.11.14 โ€” T335383 [production]
20:38 <eevans@cumin1001> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool sessionstore in eqiad: maintenance [production]
20:33 <eevans@cumin1001> START - Cookbook sre.discovery.service-route depool sessionstore in eqiad: maintenance [production]
20:13 <taavi@deploy1002> Finished scap: Backport for [[gerrit:912895|Point SyntaxHighlight at /srv/app/pygmentize (T320848)]] (duration: 08m 12s) [production]
20:06 <taavi@deploy1002> legoktm and taavi: Backport for [[gerrit:912895|Point SyntaxHighlight at /srv/app/pygmentize (T320848)]] synced to the testservers: mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]
20:05 <taavi@deploy1002> Started scap: Backport for [[gerrit:912895|Point SyntaxHighlight at /srv/app/pygmentize (T320848)]] [production]
19:42 <dancy@deploy1002> Installation of scap version "4.52.0" completed for 593 hosts [production]
19:41 <dancy@deploy1002> Installing scap version "4.52.0" for 593 hosts [production]
19:06 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
19:06 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
18:58 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
18:58 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
18:56 <otto@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
18:56 <otto@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mediawiki-page-content-change-enrichment: apply [production]
17:32 <sukhe> run authdns-update for CR 913966 [production]
16:54 <eevans@cumin1001> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) pool sessionstore in codfw: maintenance [production]
16:49 <eevans@cumin1001> START - Cookbook sre.discovery.service-route pool sessionstore in codfw: maintenance [production]
16:44 <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:912233|dewiki: Deploy Growth features to 100% of newcomers (T335385)]] (duration: 07m 22s) [production]
16:38 <urbanecm@deploy1002> urbanecm: Backport for [[gerrit:912233|dewiki: Deploy Growth features to 100% of newcomers (T335385)]] synced to the testservers: mwdebug2001.codfw.wmnet, mwdebug2002.codfw.wmnet, mwdebug1001.eqiad.wmnet, mwdebug1002.eqiad.wmnet [production]