951-1000 of 10000 results (39ms)
2025-01-21 ยง
15:52 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host kafka-main2010 [production]
15:52 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host kafka-main2010 [production]
15:52 <jhancock@cumin2002> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd2004-dev [production]
15:52 <jhancock@cumin2002> START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd2004-dev [production]
15:47 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2019.codfw.wmnet with OS bookworm [production]
15:43 <jhancock@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:41 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
15:28 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:28 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:27 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1112261|Add known-good regexes for WikibaseQualityConstraints (T380751)]] (duration: 29m 44s) [production]
15:27 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:25 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:24 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:20 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, audreypenven: Continuing with sync [production]
15:18 <jayme@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main2010.codfw.wmnet with reason: Server moving within rack [production]
15:11 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.remove_k8s_node (exit_code=0) for host toolsbeta-test-k8s-worker-14 [toolsbeta]
15:11 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.remove_k8s_node for host toolsbeta-test-k8s-worker-14 [toolsbeta]
15:07 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:07 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
15:06 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
15:05 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
15:05 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker role in the toolsbeta cluster [toolsbeta]
15:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:04 <lucaswerkmeister-wmde@deploy2002> lucaswerkmeister-wmde, audreypenven: Backport for [[gerrit:1112261|Add known-good regexes for WikibaseQualityConstraints (T380751)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
15:04 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
14:58 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1112261|Add known-good regexes for WikibaseQualityConstraints (T380751)]] [production]
14:58 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
14:56 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
14:56 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
14:54 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1107936|enable 2 factor authentication for enwiki page movers (T382879)]] (duration: 16m 10s) [production]
14:51 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
14:51 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker role in the toolsbeta cluster (T370245) [toolsbeta]
14:50 <raymond-ndibe@cloudcumin1001> END (FAIL) - Cookbook wmcs.toolforge.add_k8s_node (exit_code=99) for a worker-nfs role in the toolsbeta cluster (T370245) [toolsbeta]
14:50 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.toolforge.add_k8s_node for a worker-nfs role in the toolsbeta cluster (T370245) [toolsbeta]
14:49 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
14:49 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
14:47 <lucaswerkmeister-wmde@deploy2002> novemlinguae, lucaswerkmeister-wmde: Continuing with sync [production]
14:45 <lucaswerkmeister-wmde@deploy2002> novemlinguae, lucaswerkmeister-wmde: Backport for [[gerrit:1107936|enable 2 factor authentication for enwiki page movers (T382879)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:44 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2019.codfw.wmnet [production]
14:41 <jmm@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on ganeti2019.codfw.wmnet with reason: remove from cluster for reimage [production]
14:38 <lucaswerkmeister-wmde@deploy2002> Started scap sync-world: Backport for [[gerrit:1107936|enable 2 factor authentication for enwiki page movers (T382879)]] [production]
14:36 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1111932|Remove KartographerParsoidSupport flag from configuration (T340134)]] (duration: 19m 46s) [production]
14:35 <dcausse@deploy2002> helmfile [staging] DONE helmfile.d/services/rdf-streaming-updater: apply [production]
14:35 <dcausse@deploy2002> helmfile [staging] START helmfile.d/services/rdf-streaming-updater: apply [production]
14:27 <lucaswerkmeister-wmde@deploy2002> ihurbain, lucaswerkmeister-wmde: Continuing with sync [production]
14:26 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
14:25 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
14:24 <lucaswerkmeister-wmde@deploy2002> ihurbain, lucaswerkmeister-wmde: Backport for [[gerrit:1111932|Remove KartographerParsoidSupport flag from configuration (T340134)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:23 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics: apply [production]
14:22 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics: apply [production]