551-600 of 10000 results (33ms)
2025-10-15 ยง
18:14 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6008.drmrs.wmnet [production]
18:10 <swfrench@deploy2002> swfrench: Continuing with sync [production]
18:10 <sukhe@cumin1003> END (FAIL) - Cookbook sre.cdn.roll-reboot (exit_code=1) rolling reboot on A:cp-text_magru and not P{cp7001*} and A:cp [production]
18:07 <swfrench@deploy2002> swfrench: Backport for [[gerrit:1196503|Disable enrollment in PHP 8.3 (T405955)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
18:04 <swfrench@deploy2002> Started scap sync-world: Backport for [[gerrit:1196503|Disable enrollment in PHP 8.3 (T405955)]] [production]
17:47 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7015.magru.wmnet [production]
17:41 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:41 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:41 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:41 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:37 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6015.drmrs.wmnet [production]
17:34 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6007.drmrs.wmnet [production]
17:26 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host aqs1012.eqiad.wmnet [production]
17:23 <swfrench@deploy2002> Finished scap sync-world: Revert to PHP 8.1 - T405955 (duration: 02m 47s) [production]
17:21 <swfrench@deploy2002> Started scap sync-world: Revert to PHP 8.1 - T405955 [production]
17:06 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:06 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
17:04 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7014.magru.wmnet [production]
16:58 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:58 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:55 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6014.drmrs.wmnet [production]
16:53 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6006.drmrs.wmnet [production]
16:53 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:53 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:52 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:52 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:52 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:52 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:49 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:49 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:47 <btullis@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
16:46 <btullis@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
16:40 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) es2053 slowly with 10 steps - Pooling in new host [production]
16:39 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:37 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:37 <eevans@cumin1003> START - Cookbook sre.hosts.dhcp for host aqs1012.eqiad.wmnet [production]
16:37 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:37 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-test: apply [production]
16:20 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7013.magru.wmnet [production]
16:19 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7006.magru.wmnet [production]
16:16 <eevans@cumin1003> END (FAIL) - Cookbook sre.cassandra.roll-reboot (exit_code=1) rolling reboot on A:aqs-eqiad [production]
16:14 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6013.drmrs.wmnet [production]
16:12 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6005.drmrs.wmnet [production]
16:05 <mforns> Finished deploying Refinery at 94efa6e8221602a331c19c39ea909eeaa90d98b4 for T405533 unique devices domains [analytics]
15:57 <elukey@puppetserver1001> conftool action : set/pooled=true; selector: dnsdisc=kartotherian,name=codfw [production]
15:49 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2206.codfw.wmnet onto db2247.codfw.wmnet [production]
15:49 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2206 gradually with 4 steps - Pool db2206.codfw.wmnet in after cloning [production]
15:37 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7012.magru.wmnet [production]
15:37 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp7005.magru.wmnet [production]
15:33 <sukhe@cumin1003> cookbooks.sre.cdn.roll-reboot finished rebooting cp6012.drmrs.wmnet [production]