151-200 of 10000 results (102ms)
2026-04-21 ยง
14:24 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on tcp-proxy5004.eqsin.wmnet with reason: host reimage [production]
14:22 <cscott@deploy1003> Finished scap sync-world: Backport for [[gerrit:1275541|Bump wikimedia/parsoid to 0.23.0-a28 (T420102 T421680 T422879 T422966 T423192 T423763 T423662)]], [[gerrit:1275542|Bump wikimedia/parsoid to 0.23.0-a28 (T423662)]], [[gerrit:1275560|[tests] add ParsoidLanguageConverterTest]], [[gerrit:1275561|ParsoidLanguageConverter: update lang/dir on content wrapper div (T423747)]] (duration: 13m 02s) [production]
14:21 <jmm@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on tcp-proxy5004.eqsin.wmnet with reason: host reimage [production]
14:16 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 15 days, 0:00:00 on db2142.codfw.wmnet,pc2011.codfw.wmnet with reason: Will be decommissioned [production]
14:16 <cscott@deploy1003> cscott: Continuing with sync [production]
14:11 <cscott@deploy1003> cscott: Backport for [[gerrit:1275541|Bump wikimedia/parsoid to 0.23.0-a28 (T420102 T421680 T422879 T422966 T423192 T423763 T423662)]], [[gerrit:1275542|Bump wikimedia/parsoid to 0.23.0-a28 (T423662)]], [[gerrit:1275560|[tests] add ParsoidLanguageConverterTest]], [[gerrit:1275561|ParsoidLanguageConverter: update lang/dir on content wrapper div (T423747)]] synced to the testservers (see https://wikit [production]
14:09 <cscott@deploy1003> Started scap sync-world: Backport for [[gerrit:1275541|Bump wikimedia/parsoid to 0.23.0-a28 (T420102 T421680 T422879 T422966 T423192 T423763 T423662)]], [[gerrit:1275542|Bump wikimedia/parsoid to 0.23.0-a28 (T423662)]], [[gerrit:1275560|[tests] add ParsoidLanguageConverterTest]], [[gerrit:1275561|ParsoidLanguageConverter: update lang/dir on content wrapper div (T423747)]] [production]
14:08 <mvernon@cumin2002> START - Cookbook sre.hosts.reimage for host thanos-be1009.eqiad.wmnet with OS bullseye [production]
13:55 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2142.codfw.wmnet,db1152.eqiad.wmnet with reason: Cloning [production]
13:55 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2142: Cloning [production]
13:55 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) [production]
13:55 <marostegui@cumin1003> START - Cookbook sre.mysql.parsercache [production]
13:55 <marostegui@cumin1003> START - Cookbook sre.mysql.depool depool db2142: Cloning [production]
13:53 <jayme@cumin1003> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts wikikube-worker[1029,1089,1092,1098-1099,1106,1112].eqiad.wmnet [production]
13:53 <jayme@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:52 <ayounsi@cumin1003> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host atlas5001.wikimedia.org [production]
13:52 <ayounsi@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM atlas5001.wikimedia.org - ayounsi@cumin1003" [production]
13:52 <ayounsi@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM atlas5001.wikimedia.org - ayounsi@cumin1003" [production]
13:51 <stran@deploy1003> Finished scap sync-world: Backport for [[gerrit:1275840|Enable non-emergency categories via config (T423244)]], [[gerrit:1275825|Add next steps page for non-emergency "sockpuppetry" incidents (T423045)]], [[gerrit:1275834|Add next steps page for non-emergency "vandalism" incidents (T423563)]], [[gerrit:1275835|Add next steps page for non-emergency "user dispute" incidents (T423587)]], [[gerrit:127583 [production]
13:51 <ayounsi@cumin1003> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) atlas5001.wikimedia.org on all recursors [production]
13:51 <ayounsi@cumin1003> START - Cookbook sre.dns.wipe-cache atlas5001.wikimedia.org on all recursors [production]
13:51 <ayounsi@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:51 <ayounsi@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM atlas5001.wikimedia.org - ayounsi@cumin1003" [production]
13:50 <jayme@cumin1003> START - Cookbook sre.dns.netbox [production]
13:49 <ayounsi@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM atlas5001.wikimedia.org - ayounsi@cumin1003" [production]
13:45 <ayounsi@cumin1003> START - Cookbook sre.dns.netbox [production]
13:45 <ayounsi@cumin1003> START - Cookbook sre.ganeti.makevm for new host atlas5001.wikimedia.org [production]
13:44 <isaranto@deploy1003> helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . [production]
13:44 <jelto@deploy1003> helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply [production]
13:44 <jelto@deploy1003> helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply [production]
13:40 <stran@deploy1003> stran: Continuing with sync [production]
13:39 <ayounsi@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:39 <ayounsi@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: eqsin remove old sandbox vlan - ayounsi@cumin1003" [production]
13:38 <ayounsi@cumin1003> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: eqsin remove old sandbox vlan - ayounsi@cumin1003" [production]
13:37 <stran@deploy1003> stran: Backport for [[gerrit:1275840|Enable non-emergency categories via config (T423244)]], [[gerrit:1275825|Add next steps page for non-emergency "sockpuppetry" incidents (T423045)]], [[gerrit:1275834|Add next steps page for non-emergency "vandalism" incidents (T423563)]], [[gerrit:1275835|Add next steps page for non-emergency "user dispute" incidents (T423587)]], [[gerrit:1275836|Add next steps pa [production]
13:34 <ayounsi@cumin1003> START - Cookbook sre.dns.netbox [production]
13:30 <ayounsi@dns1004> END - running authdns-update [production]
13:29 <ayounsi@dns1004> START - running authdns-update [production]
13:27 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host tcp-proxy5004.eqsin.wmnet with OS trixie [production]
13:27 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy5004.eqsin.wmnet - jmm@cumin2002" [production]
13:27 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM tcp-proxy5004.eqsin.wmnet - jmm@cumin2002" [production]
13:26 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) tcp-proxy5004.eqsin.wmnet on all recursors [production]
13:26 <jmm@cumin2002> START - Cookbook sre.dns.wipe-cache tcp-proxy5004.eqsin.wmnet on all recursors [production]
13:26 <jmm@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:26 <jmm@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy5004.eqsin.wmnet - jmm@cumin2002" [production]
13:25 <jmm@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM tcp-proxy5004.eqsin.wmnet - jmm@cumin2002" [production]
13:20 <stran@deploy1003> Started scap sync-world: Backport for [[gerrit:1275840|Enable non-emergency categories via config (T423244)]], [[gerrit:1275825|Add next steps page for non-emergency "sockpuppetry" incidents (T423045)]], [[gerrit:1275834|Add next steps page for non-emergency "vandalism" incidents (T423563)]], [[gerrit:1275835|Add next steps page for non-emergency "user dispute" incidents (T423587)]], [[gerrit:1275836 [production]
13:16 <aude@deploy1003> Finished scap sync-world: Backport for [[gerrit:1275562|Opt-in new accounts to the ReadingLists beta feature on enwiki (T420881)]] (duration: 06m 50s) [production]
13:13 <jmm@cumin2002> START - Cookbook sre.dns.netbox [production]
13:13 <jmm@cumin2002> START - Cookbook sre.ganeti.makevm for new host tcp-proxy5004.eqsin.wmnet [production]