651-700 of 10000 results (40ms)
2026-07-16 ยง
11:51 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
11:51 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
11:50 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
11:50 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-upload_eqiad [production]
11:50 <gmodena@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
11:50 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_eqiad [production]
11:49 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-upload_esams [production]
11:49 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_esams [production]
11:48 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_eqsin [production]
11:48 <sukhe@cumin1003> START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-upload_eqsin [production]
11:47 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1256-1261,1263-1266].eqiad.wmnet [production]
11:44 <jiji@cumin1003> END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-gutter-eqiad [production]
11:43 <jiji@cumin1003> END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-gutter-codfw [production]
11:42 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1256-1261,1263-1266].eqiad.wmnet [production]
11:41 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1246-1255].eqiad.wmnet [production]
11:41 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1246-1255].eqiad.wmnet [production]
11:31 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1246-1255].eqiad.wmnet [production]
11:24 <jiji@cumin1003> START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-gutter-eqiad [production]
11:23 <jiji@cumin1003> START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-gutter-codfw [production]
11:22 <gmodena@deploy2003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
11:20 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1246-1255].eqiad.wmnet [production]
11:20 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1161-1163,1165,1240-1245].eqiad.wmnet [production]
11:20 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1161-1163,1165,1240-1245].eqiad.wmnet [production]
11:15 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
11:14 <gmodena@deploy2003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply [production]
11:13 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
11:13 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
11:09 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1161-1163,1165,1240-1245].eqiad.wmnet [production]
11:08 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2066.codfw.wmnet with OS trixie [production]
11:06 <laurabar> process-control config revision changed from 730715e1 to c951e730 [fundraising]
11:05 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
11:03 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1161-1163,1165,1240-1245].eqiad.wmnet [production]
11:03 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1151-1160].eqiad.wmnet [production]
11:03 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1151-1160].eqiad.wmnet [production]
10:59 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1068.eqiad.wmnet with OS trixie [production]
10:55 <cwilliams@cumin1003> END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) [production]
10:55 <cwilliams@cumin1003> START - Cookbook sre.mysql.major-upgrade [production]
10:54 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
10:52 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1151-1160].eqiad.wmnet [production]
10:49 <mvernon@cumin2003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2066.codfw.wmnet with reason: host reimage [production]
10:47 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1151-1160].eqiad.wmnet [production]
10:47 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1141-1150].eqiad.wmnet [production]
10:47 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1141-1150].eqiad.wmnet [production]
10:42 <mvernon@cumin2003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2066.codfw.wmnet with reason: host reimage [production]
10:41 <laurabar> process-control config revision changed from 7dddea38 to 730715e1 [fundraising]
10:39 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[1141-1150].eqiad.wmnet [production]
10:37 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply [production]
10:36 <gmodena@deploy2003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply [production]
10:33 <cgoubert@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[1141-1150].eqiad.wmnet [production]
10:33 <cgoubert@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1131-1140].eqiad.wmnet [production]