1-50 of 10000 results (16ms)
2026-03-09 ยง
20:01 <brett@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp7016.* [production]
19:54 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7001.magru.wmnet with OS trixie [production]
19:51 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7016.magru.wmnet with OS trixie [production]
19:49 <zabe@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248911|Stop writing to il_to on commonswiki (T415787)]] (duration: 06m 04s) [production]
19:45 <zabe@deploy2002> zabe: Continuing with sync [production]
19:44 <zabe@deploy2002> zabe: Backport for [[gerrit:1248911|Stop writing to il_to on commonswiki (T415787)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
19:43 <zabe@deploy2002> Started scap sync-world: Backport for [[gerrit:1248911|Stop writing to il_to on commonswiki (T415787)]] [production]
19:29 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
19:28 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
19:28 <cdobbins@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7001.magru.wmnet with reason: host reimage [production]
19:24 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7016.magru.wmnet with reason: host reimage [production]
19:23 <cdobbins@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7001.magru.wmnet with reason: host reimage [production]
19:19 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp7016.magru.wmnet with reason: host reimage [production]
19:15 <cwhite@deploy2002> Finished deploy [performance/arc-lamp@aa8da8b]: Ie7e0355f89294a2927f9dbc28afec3a62d1752de (duration: 00m 08s) [production]
19:15 <cwhite@deploy2002> Started deploy [performance/arc-lamp@aa8da8b]: Ie7e0355f89294a2927f9dbc28afec3a62d1752de [production]
19:14 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: sync [production]
19:14 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: sync [production]
19:05 <herron@deploy2002> Finished scap sync-world: Backport for [[gerrit:1249365|udp2log: switch to new hosts]] (duration: 09m 38s) [production]
19:03 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
19:03 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
19:01 <herron@deploy2002> herron: Continuing with sync [production]
19:00 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
19:00 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-cron: apply [production]
18:59 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-cron: apply [production]
18:59 <ebernhardson@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply [production]
18:59 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply [production]
18:59 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-cron: apply [production]
18:57 <herron@deploy2002> herron: Backport for [[gerrit:1249365|udp2log: switch to new hosts]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:57 <cdobbins@cumin2002> START - Cookbook sre.hosts.reimage for host cp7001.magru.wmnet with OS trixie [production]
18:55 <herron@deploy2002> Started scap sync-world: Backport for [[gerrit:1249365|udp2log: switch to new hosts]] [production]
18:55 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp7016.magru.wmnet with OS trixie [production]
18:50 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply [production]
18:49 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply [production]
18:44 <swfrench@deploy2002> helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply [production]
18:44 <swfrench@deploy2002> helmfile [eqiad] START helmfile.d/services/mw-debug: apply [production]
18:34 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: sync [production]
18:34 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: sync [production]
18:33 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: sync [production]
18:33 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: sync [production]
18:32 <wmbot~jeanfred@tools-bastion-15> Recreated Python 3.11 virtual environment using 'toolforge webservice python3.11 shell' / 'webservice-python-bootstrap --fresh' / '/data/project/integraality/www/python/venv/bin/pip install -r /data/project/integraality/integraality/requirements.txt' [tools.integraality]
18:32 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]
18:32 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: apply [production]
18:30 <wmbot~jeanfred@tools-bastion-15> Deploy 55f1132 (Switch to Python 3.11 as default interpreter) [tools.integraality]
18:29 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: sync [production]
18:29 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: sync [production]
18:27 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: sync [production]
18:27 <swfrench@deploy2002> helmfile [codfw] START helmfile.d/services/mw-debug: sync [production]
18:24 <wmftkbot> Test Kitchen edge-unique experiments (poll 232088) - adds: mobile-toc-abc, logged-out-retention-round3; removes: message; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
18:24 <wmftkbot> Test Kitchen edge-unique experiments (poll 232087) - adds: message; removes: mobile-toc-abc, logged-out-retention-round3; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
18:23 <swfrench@deploy2002> helmfile [codfw] DONE helmfile.d/services/mw-debug: apply [production]