1151-1200 of 10000 results (18ms)
2025-03-20 ยง
19:51 <jclark@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for elastic - jclark@cumin1002" [production]
19:50 <jclark@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: added mgmt for elastic - jclark@cumin1002" [production]
19:50 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp3071.esams.wmnet} and A:cp [production]
19:50 <jclark@cumin1002> START - Cookbook sre.network.configure-switch-interfaces for host elastic1116 [production]
19:46 <jclark@cumin1002> START - Cookbook sre.dns.netbox [production]
19:44 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp3071.esams.wmnet} and A:cp [production]
19:33 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in relforge [production]
19:33 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in relforge [production]
19:27 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: relforge1003* for ban host to test puppet code - bking@cumin2002 - T380752 [production]
19:27 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: relforge1003* for ban host to test puppet code - bking@cumin2002 - T380752 [production]
19:26 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in relforge [production]
19:26 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in relforge [production]
19:24 <dancy@deploy2002> Finished scap sync-world: T388761 (duration: 11m 15s) [production]
19:21 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: relforge1004* for ban host to test reimage - bking@cumin2002 - T380752 [production]
19:21 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: relforge1004* for ban host to test reimage - bking@cumin2002 - T380752 [production]
19:16 <denisse> restarting prometheus@ops.service in prometheus1005 [production]
19:13 <dancy@deploy2002> Started scap sync-world: T388761 [production]
19:11 <dancy@deploy2002> Installation of scap version "4.143.0" completed for 193 hosts [production]
19:10 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp3070.esams.wmnet} and A:cp [production]
19:07 <dancy@deploy2002> Installing scap version "4.143.0" for 193 host(s) [production]
19:03 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp3070.esams.wmnet} and A:cp [production]
18:57 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in relforge [production]
18:57 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in relforge [production]
18:51 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: relforge1003* for ban host to test reimage - bking@cumin2002 - T380752 [production]
18:51 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: relforge1003* for ban host to test reimage - bking@cumin2002 - T380752 [production]
18:51 <swfrench@deploy2002> Finished scap sync-world: Switch mw-misc to PHP 8.1 - T383845 (duration: 03m 22s) [production]
18:48 <swfrench@deploy2002> Started scap sync-world: Switch mw-misc to PHP 8.1 - T383845 [production]
18:19 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp3069.esams.wmnet} and A:cp [production]
18:12 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Unbanning all hosts in relforge [production]
18:12 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Unbanning all hosts in relforge [production]
18:10 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp3069.esams.wmnet} and A:cp [production]
18:02 <sukhe> sudo cumin -b11 'A:cp-text' 'run-puppet-agent "rolling out CR 1129349"': T350094 [production]
18:02 <sukhe> sudo cumin -b11 'A:cp-text' 'enable-puppet-agent "rolling out CR 1129349"': T350094 [production]
17:57 <sukhe> enable puppet and run agent on cp3071 to test CR 1129349 [production]
17:53 <reedy@deploy2002> Synchronized php-1.44.0-wmf.21/includes/parser/Sanitizer.php: T388733 (duration: 11m 36s) [production]
17:51 <sukhe> sudo cumin 'A:cp-text' 'disable-puppet "rolling out CR 1129349"': T350094 [production]
17:26 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp3068.esams.wmnet} and A:cp [production]
17:23 <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.ban (exit_code=0) Banning hosts: relforge1003* for ban host prior to reimage - bking@cumin2002 - T380752 [production]
17:23 <bking@cumin2002> START - Cookbook sre.elasticsearch.ban Banning hosts: relforge1003* for ban host prior to reimage - bking@cumin2002 - T380752 [production]
17:00 <brouberol@deploy2002> Finished scap build-images: Rebuild mediawiki-cli with recent dumps abspath fix (w/o cache) - T388378 (duration: 00m 56s) [production]
16:59 <brouberol@deploy2002> Started scap build-images: Rebuild mediawiki-cli with recent dumps abspath fix (w/o cache) - T388378 [production]
16:58 <brett@cumin2002> START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp3068.esams.wmnet} and A:cp [production]
16:53 <brouberol@deploy2002> Finished scap build-images: Rebuild mediawiki-cli with recent dumps abspath fix - T388378 (duration: 00m 24s) [production]
16:52 <brouberol@deploy2002> Started scap build-images: Rebuild mediawiki-cli with recent dumps abspath fix - T388378 [production]
16:49 <brett@cumin2002> END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp3067.esams.wmnet} and A:cp [production]
16:48 <fabfur> upgrade haproxykafka to 0.3.6 on A:cp (gradual rollout) [production]
16:46 <fabfur> imported haproxykafka 0.3.6 into apt repository (added TimestampType) (T388397) [production]
16:43 <jiji@deploy2002> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
16:42 <jiji@deploy2002> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
16:41 <brett> Upgrading varnish to 7.1 on cp3067 (T378737) [production]