5751-5800 of 10000 results (114ms)
2024-06-27 §
18:19 <brett@cumin2002> START - Cookbook sre.hosts.reimage for host cp5022.eqsin.wmnet with OS bullseye [production]
18:19 <eevans@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on aqs1013.eqiad.wmnet with reason: Server swap — T362033 [production]
18:18 <eevans@cumin1002> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on aqs1013.eqiad.wmnet with reason: Server swap — T362033 [production]
18:15 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
18:14 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1067.eqiad.wmnet with OS bookworm [production]
18:12 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
18:12 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
18:12 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.43.0-wmf.11 refs T366956 [production]
18:12 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1065.eqiad.wmnet with OS bookworm [production]
18:11 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
18:11 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
18:10 <brett@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp5022.eqsin.wmnet [production]
18:08 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1066.eqiad.wmnet with OS bookworm [production]
18:08 <ejegg> fundraising civicrm upgraded from 13a13f3a to 43fc2c89 [production]
18:04 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1058.eqiad.wmnet with OS bookworm [production]
17:59 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1057.eqiad.wmnet with OS bookworm [production]
17:51 <brett@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp5021.eqsin.wmnet [production]
17:50 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage [production]
17:47 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage [production]
17:45 <swfrench@deploy1002> Finished scap: Deploying securityContext changes for T362978 to main release (duration: 04m 09s) [production]
17:43 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1066.eqiad.wmnet with reason: host reimage [production]
17:41 <swfrench@deploy1002> Started scap: Deploying securityContext changes for T362978 to main release [production]
17:39 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1058.eqiad.wmnet with reason: host reimage [production]
17:37 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
17:37 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
17:36 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1057.eqiad.wmnet with reason: host reimage [production]
17:35 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
17:35 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
17:34 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1058.eqiad.wmnet with reason: host reimage [production]
17:34 <andrew@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirtlocal1003.eqiad.wmnet with OS bookworm [production]
17:34 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1066.eqiad.wmnet with reason: host reimage [production]
17:34 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1067.eqiad.wmnet with reason: host reimage [production]
17:33 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1065.eqiad.wmnet with reason: host reimage [production]
17:33 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
17:33 <andrew@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1057.eqiad.wmnet with reason: host reimage [production]
17:33 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
17:33 <swfrench-wmf> canary deployments are healthy, slow-logs still produced, continuing with main deployments for T362978 [production]
17:33 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
17:33 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
17:32 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow: apply [production]
17:32 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow: apply [production]
17:26 <hashar@deploy1002> Finished deploy [gerrit/gerrit@7659481]: Revert "Add image-diff JavaScript plugin (take 2)" (duration: 00m 07s) [production]
17:26 <hashar@deploy1002> Started deploy [gerrit/gerrit@7659481]: Revert "Add image-diff JavaScript plugin (take 2)" [production]
17:26 <hashar@deploy1002> deploy aborted: Revert Add image-diff JavaScript plugin (take 2) (duration: 00m 00s) [production]
17:26 <hashar@deploy1002> Started deploy [gerrit/gerrit@7659481]: Revert Add image-diff JavaScript plugin (take 2) [production]
17:23 <swfrench@deploy1002> Finished scap: (no justification provided) (duration: 08m 03s) [production]
17:19 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1067.eqiad.wmnet with OS bookworm [production]
17:19 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1066.eqiad.wmnet with OS bookworm [production]
17:19 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1065.eqiad.wmnet with OS bookworm [production]
17:18 <andrew@cumin1002> START - Cookbook sre.hosts.reimage for host cloudvirt1058.eqiad.wmnet with OS bookworm [production]