51-100 of 10000 results (105ms)
2026-06-10 ยง
17:23 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
17:23 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2174: Upgrading db2174.codfw.wmnet [production]
17:23 <jasmine@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
17:23 <jasmine@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main2010.codfw.wmnet with reason: host reimage [production]
17:23 <jasmine@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:22 <cwilliams@cumin1003> START - Cookbook sre.mysql.depool depool db2174: Upgrading db2174.codfw.wmnet [production]
17:22 <jasmine@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:22 <bblack@cumin1003> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-upload and not P{cp7008.magru.wmnet} and A:cp - Upgrade wmfuniq to 0.3.0 () [production]
17:22 <jasmine@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
17:22 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
17:22 <bblack@cumin1003> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-text and not P{cp7008*} and A:cp - Upgrade wmfuniq to 0.3.0 () [production]
17:21 <jasmine@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]
17:21 <jasmine@deploy1003> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
17:20 <jasmine@deploy1003> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
17:20 <jasmine@deploy1003> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:20 <jasmine@deploy1003> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
17:20 <jasmine@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
17:19 <jasmine@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
17:19 <jasmine@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:18 <jasmine@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
17:18 <jasmine@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
17:17 <jasmine@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
17:17 <jasmine@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
17:17 <jasmine@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:15 <jasmine@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
17:14 <jasmine@deploy1003> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
17:13 <jasmine@deploy1003> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
17:12 <sukhe@cumin1003> END (PASS) - Cookbook sre.dns.roll-restart-ntp (exit_code=0) rolling restart_daemons on A:dnsbox and (A:dnsbox) [production]
17:03 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
17:03 <cwilliams@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1206: Migration of db1206.eqiad.wmnet completed [production]
17:02 <jasmine@cumin2002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host kafka-main2010 [production]