151-200 of 10000 results (12ms)
2026-03-19 ยง
16:18 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2003.codfw.wmnet [production]
16:17 <jforrester@deploy2002> Started scap sync-world: Backport for [[gerrit:1255773|[abstractwiki] Temporarily disable wgWikiLambdaEnableAbstractMode to see if this means we can create the wiki (T420531)]] [production]
16:17 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) netbox.discovery.wmnet. on all recursors [production]
16:17 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache netbox.discovery.wmnet. on all recursors [production]
16:17 <jmm@cumin2002> START - Cookbook sre.netbox.restart-reboot rolling reboot on A:netbox [production]
16:16 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host hcaptcha-proxy4003.wikimedia.org [production]
16:16 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host hcaptcha-proxy4003.wikimedia.org with OS bookworm [production]
16:15 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-worker1142.eqiad.wmnet [production]
16:14 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host flink-zk2003.codfw.wmnet [production]
16:14 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2002.codfw.wmnet [production]
16:13 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5026.eqsin.wmnet with reason: host reimage [production]
16:10 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host flink-zk2002.codfw.wmnet [production]
16:09 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5025.eqsin.wmnet with reason: host reimage [production]
16:08 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
16:08 <brouberol@deploy2002> helmfile [codfw] DONE helmfile.d/admin 'apply'. [production]
16:07 <brouberol@deploy2002> helmfile [codfw] START helmfile.d/admin 'apply'. [production]
16:06 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host an-worker1142.eqiad.wmnet [production]
16:06 <brouberol@deploy2002> helmfile [eqiad] DONE helmfile.d/admin 'apply'. [production]
16:06 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2001.codfw.wmnet [production]
16:05 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5026.eqsin.wmnet with reason: host reimage [production]
16:05 <brett@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cp5025.eqsin.wmnet with reason: host reimage [production]
16:05 <brouberol@deploy2002> helmfile [eqiad] START helmfile.d/admin 'apply'. [production]
16:02 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host flink-zk2001.codfw.wmnet [production]
16:01 <Krinkle> Hoist l10n-bot rights from labs/tools parent to labs parent to reduce duplication in other labs/ repos [releng]
15:59 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on hcaptcha-proxy4003.wikimedia.org with reason: host reimage [production]
15:56 <wmftkbot> Test Kitchen mw-user experiment (poll 1) - adds: we-3-3-4-reading-list-test1, growthexperiments-revise-tone, we-3-3-4-reading-list-test1-en; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
15:56 <wmftkbot> Test Kitchen edge-unique experiments (poll 1) - adds: attribution-research-short-baseline-run, share-highlight-baseline, logged-out-retention-round3, synth-aa-test-traffic-impact-3, growthexperiments-editattempt-anonwarning, synth-aa-test-traffic-impact-2, mobile-toc-abc2, synth-aa-test-traffic-impact-1; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [analytics]
15:53 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on hcaptcha-proxy4003.wikimedia.org with reason: host reimage [production]
15:53 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
15:50 <Krinkle> Create labs/xtools repo (branch: main, parent: labs, owner: labs-xtools), ref T402086 [releng]
15:41 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
15:36 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief2002.codfw.wmnet [production]
15:35 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp5025.eqsin.wmnet with OS trixie [production]
15:34 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp5026.eqsin.wmnet with OS trixie [production]
15:34 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp5025.eqsin.wmnet with OS trixie [production]
15:34 <brett@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp5026.eqsin.wmnet with OS trixie [production]
15:32 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host acmechief2002.codfw.wmnet [production]
15:32 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief1002.eqiad.wmnet [production]
15:32 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host hcaptcha-proxy4003.wikimedia.org with OS bookworm [production]
15:31 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy4003.wikimedia.org - jmm@cumin2002" [production]
15:31 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM hcaptcha-proxy4003.wikimedia.org - jmm@cumin2002" [production]
15:31 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) hcaptcha-proxy4003.wikimedia.org on all recursors [production]
15:31 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache hcaptcha-proxy4003.wikimedia.org on all recursors [production]
15:31 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:31 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM hcaptcha-proxy4003.wikimedia.org - jmm@cumin2002" [production]
15:30 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test2001.codfw.wmnet [production]
15:29 <brett@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test1001.eqiad.wmnet [production]
15:29 <taavi@cloudcumin1001> START - Cookbook wmcs.toolforge.k8s.reboot for all nodes [tools]
15:28 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host acmechief1002.eqiad.wmnet [production]
15:26 <brett@cumin2002> START - Cookbook sre.hosts.reboot-single for host acmechief-test2001.codfw.wmnet [production]