101-150 of 10000 results (105ms)
2026-03-20 ยง
13:14 <jiji@cumin1003> END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-canary [production]
13:14 <sukhe@cumin1003> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for doh[3005-3006].wikimedia.org [production]
13:14 <sukhe@cumin1003> START - Cookbook sre.hosts.remove-downtime for doh[3005-3006].wikimedia.org [production]
13:08 <jiji@cumin1003> START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-canary [production]
13:05 <kevinbazira@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
13:03 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
12:59 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
12:58 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
12:57 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest2006.codfw.wmnet [production]
12:56 <cparle@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
12:55 <cparle@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
12:51 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host sretest2006.codfw.wmnet [production]
12:50 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest2001.codfw.wmnet [production]
12:50 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . [production]
12:45 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host sretest2001.codfw.wmnet [production]
12:40 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest1005.eqiad.wmnet [production]
12:35 <jiji@cumin1003> END (ERROR) - Cookbook sre.memcached.roll-reboot-restart (exit_code=97) rolling reboot on A:memcached-codfw [production]
12:34 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host sretest1005.eqiad.wmnet [production]
12:31 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw2001.wikimedia.org [production]
12:28 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ldap-rw2001.wikimedia.org [production]
12:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-rw1001.wikimedia.org [production]
12:20 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ldap-rw1001.wikimedia.org [production]
11:43 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1172.eqiad.wmnet with OS bullseye [production]
11:42 <btullis@cumin1003> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host an-worker1172.eqiad.wmnet with OS bullseye [production]
11:27 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host an-worker1172.eqiad.wmnet with OS bullseye [production]
11:24 <jiji@cumin1003> START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-codfw [production]
10:26 <jiji@cumin1003> END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-codfw [production]
10:13 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
10:12 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
10:10 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
10:05 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
10:05 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
10:04 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
10:02 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:58 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:57 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:57 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
09:56 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:56 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:55 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:53 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:50 <fceratto@deploy2002> helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . [production]
09:50 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]
09:47 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
09:46 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.print-network-topology (exit_code=0) [production]
09:46 <jayme@cumin1003> START - Cookbook sre.k8s.print-network-topology [production]
09:45 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.print-network-topology (exit_code=0) [production]
09:45 <kevinbazira@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . [production]
09:45 <jayme@cumin1003> START - Cookbook sre.k8s.print-network-topology [production]
09:38 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. [production]