2351-2400 of 10000 results (107ms)
2024-11-15 ยง
20:31 <jhancock@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding restbase2036 to codfw - jhancock@cumin2002" [production]
20:31 <jhancock@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding restbase2036 to codfw - jhancock@cumin2002" [production]
20:27 <jhancock@cumin2002> START - Cookbook sre.dns.netbox [production]
19:54 <dancy@deploy2002> Finished scap sync-world: Testing T377883 (duration: 03m 06s) [production]
19:51 <dancy@deploy2002> Started scap sync-world: Testing T377883 [production]
19:50 <dancy@deploy2002> Installation of scap version "4.124.0" completed for 206 hosts [production]
19:46 <dancy@deploy2002> Installing scap version "4.124.0" for 206 hosts [production]
18:53 <bking@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
18:52 <bking@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
18:35 <cjming@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic: apply [production]
18:34 <cjming@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic: apply [production]
18:32 <cjming@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mpic-next: apply [production]
18:31 <cjming@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mpic-next: apply [production]
18:15 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
18:15 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
18:09 <elukey@cumin1002> END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
18:08 <elukey@cumin1002> START - Cookbook sre.hosts.provision for host thanos-be2005.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART [production]
16:58 <mfossati@deploy2002> Finished deploy [airflow-dags/platform_eng@82083c4]: image suggestions hotfix - section titles denylist dependency (duration: 01m 58s) [production]
16:57 <taavi> copy python3-flask-{keystone,oslolog} from bullseye-wikimedia to bookworm-wikimedia [production]
16:56 <mfossati@deploy2002> Started deploy [airflow-dags/platform_eng@82083c4]: image suggestions hotfix - section titles denylist dependency [production]
16:27 <herron@cumin2002> conftool action : set/pooled=yes; selector: name=aux-k8s-worker1005.eqiad.wmnet,cluster=aux-k8s,service=kubesvc [production]
16:27 <herron@cumin2002> conftool action : set/weight=10; selector: name=aux-k8s-worker1005.eqiad.wmnet,cluster=aux-k8s,service=kubesvc [production]
16:22 <herron@cumin2002> conftool action : set/pooled=yes; selector: name=aux-k8s-worker1004.eqiad.wmnet,cluster=aux-k8s,service=kubesvc [production]
16:22 <herron@cumin2002> conftool action : set/weight=10; selector: name=aux-k8s-worker1004.eqiad.wmnet,cluster=aux-k8s,service=kubesvc [production]
16:09 <sukhe@puppetserver1001> conftool action : set/pooled=yes; selector: name=cp4043.ulsfo.wmnet [reason: ATS fixed] [production]
16:08 <sukhe@cumin1002> END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp4043.ulsfo.wmnet [production]
16:08 <sukhe@cumin1002> START - Cookbook sre.hosts.remove-downtime for cp4043.ulsfo.wmnet [production]
16:06 <sukhe@cumin1002> END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade/restart of Apache Traffic Server on P{cp4051*} and A:cp for 9.2.6-1wm2 [production]
16:03 <sukhe@cumin1002> START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade/restart of Apache Traffic Server on P{cp4051*} and A:cp for 9.2.6-1wm2 [production]
16:00 <sukhe> reprepro -C main include bullseye-wikimedia trafficserver_9.2.6-1wm2_amd64.changes: T379797 [production]
15:47 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db2230.codfw.wmnet,db1125.eqiad.wmnet with reason: testing stuff on test-s4 [production]
15:47 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db2230.codfw.wmnet,db1125.eqiad.wmnet with reason: testing stuff on test-s4 [production]
15:42 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from eqiad to codfw [production]
15:41 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.finalize for the switch from eqiad to codfw [production]
15:40 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.finalize (exit_code=0) for the switch from codfw to eqiad [production]
15:39 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.finalize for the switch from codfw to eqiad [production]
15:39 <arnaudb@cumin1002> END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from codfw to eqiad [production]
15:38 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
15:38 <arnaudb@cumin1002> START - Cookbook sre.switchdc.databases.prepare for the switch from codfw to eqiad [production]
15:37 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply [production]
15:35 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:34 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
13:59 <ayounsi@cumin1002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
13:59 <ayounsi@cumin1002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove e8 lo0 IP - ayounsi@cumin1002" [production]
13:59 <ayounsi@cumin1002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Remove e8 lo0 IP - ayounsi@cumin1002" [production]
13:55 <ayounsi@cumin1002> START - Cookbook sre.dns.netbox [production]
13:55 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) [production]
13:52 <ayounsi@cumin1002> START - Cookbook sre.dns.netbox [production]
13:41 <XioNoX> test no-passwords on mr1-eqsin - T379464 [production]
13:31 <ayounsi@cumin1002> END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts sretest1004.eqiad.wmnet [production]