1-50 of 10000 results (102ms)
2026-03-18 ยง
13:46 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1097.eqiad.wmnet [production]
13:45 <mszwarc@deploy2002> mszwarc: Continuing with sync [production]
13:43 <mszwarc@deploy2002> mszwarc: Backport for [[gerrit:1254916|Normalize external domain names in click analysis (T419837)]], [[gerrit:1254917|Normalize external domain names in click analysis (T419837)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:43 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2096.codfw.wmnet [production]
13:41 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host wdqs1033.eqiad.wmnet with OS trixie [production]
13:41 <jclark@cumin1003> START - Cookbook sre.hosts.reimage for host wikikube-worker1373.eqiad.wmnet with OS bookworm [production]
13:41 <mszwarc@deploy2002> Started scap sync-world: Backport for [[gerrit:1254916|Normalize external domain names in click analysis (T419837)]], [[gerrit:1254917|Normalize external domain names in click analysis (T419837)]] [production]
13:40 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1248095|filebackend: Remove outdated comment]], [[gerrit:1254216|GrowthExperiments: increase edit and thanks query limit II (T341599)]] (duration: 08m 47s) [production]
13:40 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet [production]
13:39 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1044.eqiad.wmnet [production]
13:39 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1097.eqiad.wmnet [production]
13:39 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1096.eqiad.wmnet [production]
13:37 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2096.codfw.wmnet [production]
13:36 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host dse-k8s-worker1016.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
13:36 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2095.codfw.wmnet [production]
13:36 <sgimeno@deploy2002> matmarex, sgimeno: Continuing with sync [production]
13:34 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1044.eqiad.wmnet [production]
13:33 <sgimeno@deploy2002> matmarex, sgimeno: Backport for [[gerrit:1248095|filebackend: Remove outdated comment]], [[gerrit:1254216|GrowthExperiments: increase edit and thanks query limit II (T341599)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
13:31 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1096.eqiad.wmnet [production]
13:31 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1095.eqiad.wmnet [production]
13:31 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1248095|filebackend: Remove outdated comment]], [[gerrit:1254216|GrowthExperiments: increase edit and thanks query limit II (T341599)]] [production]
13:30 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2095.codfw.wmnet [production]
13:30 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2094.codfw.wmnet [production]
13:28 <sgimeno@deploy2002> Finished scap sync-world: Backport for [[gerrit:1254894|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254895|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254891|Revert "SpecialPreferences: Use Language Select Widget in language field" (T419895)]], [[gerrit:1254890|Revert "SpecialPreferences: Use Language Select Widget in lan [production]
13:28 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker1027.eqiad.wmnet with OS bookworm [production]
13:28 <btullis@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
13:27 <btullis@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker1026.eqiad.wmnet [production]
13:27 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1044.eqiad.wmnet [production]
13:26 <btullis@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" [production]
13:25 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1095.eqiad.wmnet [production]
13:25 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1094.eqiad.wmnet [production]
13:24 <sgimeno@deploy2002> somerandomdeveloper, sgimeno: Continuing with sync [production]
13:24 <sgimeno@deploy2002> somerandomdeveloper, sgimeno: Backport for [[gerrit:1254894|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254895|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254891|Revert "SpecialPreferences: Use Language Select Widget in language field" (T419895)]], [[gerrit:1254890|Revert "SpecialPreferences: Use Language Select Widget in [production]
13:23 <btullis@cumin1003> START - Cookbook sre.hosts.provision for host dse-k8s-worker1016.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED [production]
13:23 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2094.codfw.wmnet [production]
13:23 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2093.codfw.wmnet [production]
13:22 <sgimeno@deploy2002> Started scap sync-world: Backport for [[gerrit:1254894|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254895|loggedOutWarning: dont set the schema for experiment events (T420451)]], [[gerrit:1254891|Revert "SpecialPreferences: Use Language Select Widget in language field" (T419895)]], [[gerrit:1254890|Revert "SpecialPreferences: Use Language Select Widget in lang [production]
13:21 <jmm@cumin2002> END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1043.eqiad.wmnet [production]
13:21 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1043.eqiad.wmnet [production]
13:21 <btullis@cumin1003> START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker1026.eqiad.wmnet [production]
13:20 <dpogorzelski@deploy2002> helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. [production]
13:16 <mvernon@cumin2002> START - Cookbook sre.hosts.reboot-single for host ms-be2093.codfw.wmnet [production]
13:16 <mvernon@cumin2002> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2092.codfw.wmnet [production]
13:16 <jmm@cumin2002> START - Cookbook sre.hosts.reboot-single for host ganeti1043.eqiad.wmnet [production]
13:16 <mvernon@cumin1003> START - Cookbook sre.hosts.reboot-single for host ms-be1094.eqiad.wmnet [production]
13:16 <mvernon@cumin1003> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be1093.eqiad.wmnet [production]
13:15 <jclark@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:15 <jclark@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update network and mgmt - jclark@cumin1003" [production]
13:15 <jclark@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update network and mgmt - jclark@cumin1003" [production]
13:12 <jmm@cumin2002> START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1043.eqiad.wmnet [production]