301-350 of 10000 results (31ms)
2023-09-15 ยง
14:32 <bking@deploy1002> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:32 <bking@deploy1002> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
14:31 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2005-dev.codfw.wmnet with OS bookworm [production]
14:29 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt2004-dev.codfw.wmnet with OS bookworm [production]
14:27 <aborrero@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt2006-dev [production]
14:27 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt2006-dev [production]
14:26 <aborrero@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt2005-dev [production]
14:26 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt2005-dev [production]
14:25 <aborrero@cumin1001> END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt2004-dev [production]
14:24 <aborrero@cumin1001> START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt2004-dev [production]
14:06 <cgoubert@cumin1001> conftool action : set/pooled=yes; selector: name=mw2444.codfw.wmnet [production]
14:05 <claime> repooling mw2444.codfw.wmnet - T345884 [production]
13:51 <slyngshede@cumin1001> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idm-test1001.wikimedia.org [production]
13:47 <slyngshede@cumin1001> START - Cookbook sre.ganeti.reboot-vm for VM idm-test1001.wikimedia.org [production]
13:46 <slyngshede@cumin1001> END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM idm-test1001.wikimedia.org [production]
13:41 <slyngshede@cumin1001> START - Cookbook sre.ganeti.reboot-vm for VM idm-test1001.wikimedia.org [production]
13:41 <slyngshede@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host idm-test1001.wikimedia.org with OS bookworm [production]
13:40 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt2004-dev.codfw.wmnet with reason: host reimage [production]
13:40 <hashar> Reloading Zuul to enable SonarQube for CologneBlue, Interwiki, ParserFunctions and Timeless # T321837 [releng]
13:38 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt2006-dev.codfw.wmnet with reason: host reimage [production]
13:38 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on cloudvirt2005-dev.codfw.wmnet with reason: host reimage [production]
13:35 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt2005-dev.codfw.wmnet with reason: host reimage [production]
13:35 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt2004-dev.codfw.wmnet with reason: host reimage [production]
13:35 <andrew@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt2006-dev.codfw.wmnet with reason: host reimage [production]
13:19 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt2004-dev.codfw.wmnet with OS bookworm [production]
13:19 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt2005-dev.codfw.wmnet with OS bookworm [production]
13:19 <slyngshede@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on idm-test1001.wikimedia.org with reason: host reimage [production]
13:19 <andrew@cumin1001> START - Cookbook sre.hosts.reimage for host cloudvirt2006-dev.codfw.wmnet with OS bookworm [production]
13:16 <slyngshede@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on idm-test1001.wikimedia.org with reason: host reimage [production]
13:03 <slyngshede@cumin1001> START - Cookbook sre.hosts.reimage for host idm-test1001.wikimedia.org with OS bookworm [production]
13:01 <akosiaris@deploy1002> Synchronized docroot: (no justification provided) (duration: 08m 20s) [production]
12:50 <topranks> changing ECMP hasing algorithm on drmrs, esams and cloud switches T339852 [production]
12:32 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component maintain-kubeusers [tools]
12:31 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusers [tools]
12:27 <topranks> changing ECMP hasing algorithm on asw1-b12-drmrs T339852 [production]
12:26 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component maintain-kubeusers [toolsbeta]
12:26 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component maintain-kubeusers [toolsbeta]
12:06 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-65 (T346123) [tools]
11:57 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-65 (T346123) [tools]
11:55 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-34 (T346123) [tools]
11:54 <_joe_> updated etcd-mirror to 0.0.10 everywhere [production]
11:46 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-34 (T346123) [tools]
11:43 <arturo> merging NAT change for T346426 in cloudgw [admin]
11:37 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1138.eqiad.wmnet with OS bullseye [production]
11:12 <stevemunene@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1138.eqiad.wmnet with reason: host reimage [production]
11:09 <stevemunene@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1138.eqiad.wmnet with reason: host reimage [production]
10:56 <stevemunene@cumin1001> START - Cookbook sre.hosts.reimage for host an-worker1138.eqiad.wmnet with OS bullseye [production]
10:52 <wm-bot> <superpes> Restarted SULWatcher stucked on IRC [tools.stewardbots]
10:32 <arturo> faiolver cloudgw1001 into cloudgw1002, investigating a nftables syntax error (T346432) [admin]
10:10 <wm-bot2> dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-52 (T346123) [tools]