251-300 of 10000 results (95ms)
2026-03-12 ยง
16:54 <jclark@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on ms-backup1004.eqiad.wmnet with reason: host reimage [production]
16:50 <swfrench-wmf> reprepro include php-apcu_5.1.24-1+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
16:45 <akhatun@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-edit-type-enrich-next: apply [production]
16:45 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:44 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:43 <akhatun@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-edit-type-enrich-next: apply [production]
16:43 <swfrench-wmf> reprepro include dh-php_5.5+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
16:42 <btullis@cumin1003> START - Cookbook sre.hosts.reimage for host dse-k8s-worker1018.eqiad.wmnet with OS bookworm [production]
16:40 <swfrench-wmf> reprepro include php-defaults_94+wmf11u1+icu72u1 into component/php83-icu72 - T419058 [production]
16:37 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host ms-backup1004.eqiad.wmnet with OS trixie [production]
16:36 <swfrench-wmf> reprepro include php8.3_8.3.30-1+wmf11u2+icu72u1 into component/php83-icu72 - T419058 [production]
16:27 <dzahn@dns1004> END - running authdns-update [production]
16:26 <dzahn@dns1004> START - running authdns-update [production]
16:25 <mutante> switching old status.wikimedia.org page away from rackspace T414098 [production]
16:25 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp4045.ulsfo.wmnet with OS trixie [production]
16:20 <dzahn@deploy2002> helmfile [eqiad] DONE helmfile.d/services/miscweb: apply [production]
16:20 <dzahn@deploy2002> helmfile [eqiad] START helmfile.d/services/miscweb: apply [production]
16:19 <dzahn@deploy2002> helmfile [codfw] DONE helmfile.d/services/miscweb: apply [production]
16:19 <dzahn@deploy2002> helmfile [codfw] START helmfile.d/services/miscweb: apply [production]
16:12 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
16:11 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply [production]
16:10 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply [production]
16:09 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply [production]
16:09 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply [production]
16:09 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:08 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
16:08 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply [production]
16:07 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply [production]
16:06 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply [production]
16:05 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-research: apply [production]
16:04 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-research: apply [production]
16:04 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
16:04 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
16:03 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply [production]
16:02 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply [production]
16:02 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-fr-tech: apply [production]
16:02 <kevinbazira@deploy2002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . [production]
16:01 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-fr-tech: apply [production]
15:58 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:57 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply [production]
15:57 <joal@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
15:56 <joal@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply [production]
15:52 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudgw2002-dev.codfw.wmnet [production]
15:52 <andrew@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:52 <andrew@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudgw2002-dev.codfw.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin2002" [production]
15:47 <andrew@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudgw2002-dev.codfw.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin2002" [production]
15:43 <andrew@cumin2002> START - Cookbook sre.dns.netbox [production]
15:41 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:40 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
15:36 <andrew@cumin2002> START - Cookbook sre.hosts.decommission for hosts cloudgw2002-dev.codfw.wmnet [production]