251-300 of 10000 results (10ms)
2026-03-23 §
09:00 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2060-2062,2064-2065,2067-2075].codfw.wmnet [production]
08:59 <fceratto@cumin1003> END (FAIL) - Cookbook sre.switchdc.databases.prepare (exit_code=99) for the switch from eqiad to codfw for section test-s4 [production]
08:59 <fceratto@cumin1003> START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section test-s4 [production]
08:59 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2038-2039,2041-2042,2044,2046,2049-2051,2055-2059].codfw.wmnet [production]
08:59 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2038-2039,2041-2042,2044,2046,2049-2051,2055-2059].codfw.wmnet [production]
08:50 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2038-2039,2041-2042,2044,2046,2049-2051,2055-2059].codfw.wmnet [production]
08:46 <kharlan@deploy2002> Finished scap sync-world: Backport for [[gerrit:1255736|hcaptcha: Use the global edit key for MobileFrontend edits if present (T420574)]] (duration: 14m 42s) [production]
08:44 <dpogorzelski@deploy2002> helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. [production]
08:43 <dpogorzelski@deploy2002> helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. [production]
08:41 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2038-2039,2041-2042,2044,2046,2049-2051,2055-2059].codfw.wmnet [production]
08:40 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2005-2006,2011-2018,2033-2037].codfw.wmnet [production]
08:40 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2005-2006,2011-2018,2033-2037].codfw.wmnet [production]
08:40 <dpogorzelski@deploy2002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
08:39 <kharlan@deploy2002> kharlan: Continuing with sync [production]
08:38 <dpogorzelski@deploy2002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
08:37 <kharlan@deploy2002> kharlan: Backport for [[gerrit:1255736|hcaptcha: Use the global edit key for MobileFrontend edits if present (T420574)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
08:36 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply [production]
08:35 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
08:35 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
08:31 <kharlan@deploy2002> Started scap sync-world: Backport for [[gerrit:1255736|hcaptcha: Use the global edit key for MobileFrontend edits if present (T420574)]] [production]
08:29 <jayme@cumin1003> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2005-2006,2011-2018,2033-2037].codfw.wmnet [production]
08:19 <jayme@cumin1003> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2005-2006,2011-2018,2033-2037].codfw.wmnet [production]
08:18 <jayme@cumin1003> START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{wikikube-worker[2005-2006,2011-2018,2033-2039,2041-2042,2044,2046,2049-2051,2055-2062,2064-2065,2067-2078,2087-2095,2102-2115,2124-2179,2184-2199].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
07:45 <kartik@deploy2002> Finished scap sync-world: Backport for [[gerrit:1254149|Enable ULS rewrite beta feature (T418187 T253303)]] (duration: 41m 30s) [production]
07:42 <brouberol@deploy2002> helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/kafka-mirrormaker: apply [production]
07:33 <brouberol@deploy2002> helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/kafka-mirrormaker: apply [production]
07:30 <kartik@deploy2002> kartik, abi: Continuing with sync [production]
07:30 <brouberol@deploy2002> helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/kafka-mirrormaker: apply [production]
07:29 <brouberol@deploy2002> helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/kafka-mirrormaker: apply [production]
07:22 <kartik@deploy2002> kartik, abi: Backport for [[gerrit:1254149|Enable ULS rewrite beta feature (T418187 T253303)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:18 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
07:18 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
07:17 <brouberol@deploy2002> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
07:16 <brouberol@deploy2002> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
07:03 <kartik@deploy2002> Started scap sync-world: Backport for [[gerrit:1254149|Enable ULS rewrite beta feature (T418187 T253303)]] [production]
02:08 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 07m 55s) [production]
02:00 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
01:07 <wmbot~lucaswerkmeister@tools-bastion-15> toolforge jobs restart bridgebot [tools.bridgebot]
2026-03-22 §
14:52 <Reedy> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1258082 [releng]
02:50 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on doh7004.wikimedia.org with reason: depooled host [production]
02:50 <sukhe@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on doh7003.wikimedia.org with reason: depooled host [production]
02:09 <mwpresync@deploy2002> Finished scap build-images: Publishing wmf/next image (duration: 08m 21s) [production]
02:01 <mwpresync@deploy2002> Started scap build-images: Publishing wmf/next image [production]
01:00 <Krinkle> Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1256488 [releng]
2026-03-21 §
22:43 <wmbot~lokal-profil@tools-bastion-15> Deploy 67535ab, 7fe62d4 (T420703), 247b6a6 (T420013) [tools.heritage]
16:39 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/23383959557 (https://github.com/cluebotng/component-configs/commits/93c7795074704e8f5e28a9664a00d04cfd26c09c) [tools.cluebotng-editsets]
16:39 <wm-bot2> Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/23383959549 (https://github.com/cluebotng/component-configs/commits/93c7795074704e8f5e28a9664a00d04cfd26c09c) [tools.cluebotng-trainer]
16:26 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/23383557597 (https://github.com/cluebotng/component-configs/commits/0b67216b47074dd5d1d279dde0aa9144b243cf01) [tools.cluebotng]
16:26 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/23383565693 (https://github.com/cluebotng/component-configs/commits/48390b500ab2b65905e09987c12a3e42c3f69778) [tools.cluebotng-review]
16:26 <wm-bot2> Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/23383640343 (https://github.com/cluebotng/component-configs/commits/3497a25c3d209bdf8f64f3ec3e77e52f2f8debfa) [tools.cluebotng-trainer]