151-200 of 10000 results (43ms)
2026-10-20 ยง
15:23 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]
15:23 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply [production]
15:21 <btullis@cumin1004> START - Cookbook sre.hosts.provision for host druid-internal1004.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART [production]
15:13 <vgutierrez@cumin1004> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) pooling P{lvs7002.*} and A:liberica [production]
15:13 <vgutierrez@cumin1004> START - Cookbook sre.loadbalancer.admin pooling P{lvs7002.*} and A:liberica [production]
15:05 <elukey@cumin1004> END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-main-eqiad [production]
15:05 <bking@cumin2003> START - Cookbook sre.wdqs.reboot [production]
15:04 <dancy@deploy1003> Started scap sync-world: testwikis to 1.48.0-wmf.1 refs T438222 [production]
15:00 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:ml-staging-worker [production]
15:00 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2003.codfw.wmnet [production]
15:00 <klausman@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2003.codfw.wmnet [production]
14:58 <bking@cumin2003> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
14:57 <cscott@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply [production]
14:57 <cscott@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply [production]
14:57 <vgutierrez@cumin1004> END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs7002.*} and A:liberica [production]
14:57 <effie> depooled eqiad for mw-web T440896 [production]
14:57 <vgutierrez@cumin1004> START - Cookbook sre.loadbalancer.admin depooling P{lvs7002.*} and A:liberica [production]
14:55 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2003.codfw.wmnet [production]
14:52 <jiji@cumin1004> END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool mw-web-ro in eqiad: T440896 [production]
14:52 <dkertesz@cumin1004> END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_magru and not P{cp7001.*} and A:cp - upgrade haproxy to 3.2.26-1 (T441435) [production]
14:48 <bking@cumin2003> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
14:47 <jiji@cumin1004> START - Cookbook sre.discovery.service-route depool mw-web-ro in eqiad: T440896 [production]
14:45 <elukey@cumin1004> START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling restart_daemons on A:kafka-main-eqiad [production]
14:45 <klausman@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2003.codfw.wmnet [production]
14:45 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2002.codfw.wmnet [production]
14:45 <klausman@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2002.codfw.wmnet [production]
14:44 <elukey@cumin1004> END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-main-codfw [production]
14:43 <bking@cumin2003> START - Cookbook sre.wdqs.reboot [production]
14:41 <vgutierrez> upload ipip-multiqueue-optimizer 0.3+deb13u1 to trixie-wikimedia (apt.wm.o) - T401832 [production]
14:40 <vgutierrez@cumin1004> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs7003.magru.wmnet with OS trixie [production]
14:40 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging2002.codfw.wmnet [production]
14:39 <bking@cumin2003> START - Cookbook sre.wdqs.reboot [production]
14:38 <bking@cumin2003> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
14:37 <cscott@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply [production]
14:37 <cscott@deploy1003> helmfile [codfw] START helmfile.d/services/mw-parsoid: apply [production]
14:37 <trueg@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply [production]
14:37 <bking@cumin2003> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]
14:34 <jiji@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-web: apply [production]
14:34 <jiji@deploy1003> helmfile [codfw] START helmfile.d/services/mw-web: apply [production]
14:32 <elukey@cumin1004> END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-logging-eqiad [production]
14:30 <klausman@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging2002.codfw.wmnet [production]
14:30 <klausman@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging2001.codfw.wmnet [production]
14:30 <klausman@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging2001.codfw.wmnet [production]
14:29 <jiji@deploy1003> helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply [production]
14:29 <jiji@deploy1003> helmfile [codfw] START helmfile.d/services/mw-api-ext: apply [production]
14:29 <bking@cumin2003> START - Cookbook sre.wdqs.reboot [production]
14:29 <bking@cumin2003> START - Cookbook sre.wdqs.reboot [production]
14:29 <ayounsi@cumin1004> END (PASS) - Cookbook sre.network.sync-bgp-netbox (exit_code=0) [production]
14:29 <ayounsi@cumin1004> START - Cookbook sre.network.sync-bgp-netbox [production]
14:29 <bking@cumin2003> END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) [production]