Search

On or before date

go

2026-07-06 §
16:42	<andrewbogott>	running "find . -name ubuntu24.img -delete" and "find . -name ubuntu22.img -delete" in /srv/paws/project/paws/userhomes	[paws]
2026-07-02 §
16:46	<dcaro@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'tlepage' in role 'member' (T427914)	[paws]
16:46	<dcaro@cloudcumin1001>	START - Cookbook wmcs.vps.add_user_to_project for user 'tlepage' in role 'member' (T427914)	[paws]
2026-06-29 §
13:15	<andrewbogott>	rm -rf /srv/paws/files-to-remove/* on paws-nfs-2	[paws]
2026-06-23 §
19:30	<andrew@cloudcumin1001>	END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99)	[paws]
19:30	<andrew@cloudcumin1001>	START - Cookbook wmcs.nfs.migrate_service	[paws]
19:19	<andrew@cloudcumin1001>	END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0)	[paws]
19:08	<andrew@cloudcumin1001>	START - Cookbook wmcs.nfs.add_server	[paws]
2026-06-22 §
15:43	<andrewbogott>	rm -rf /srv/paws/files-to-remove/* for T429578	[paws]
2026-05-28 §
17:25	<andrewbogott>	switched proxies to new paws release featuring pywikibot 1.30.0	[paws]
2026-05-07 §
21:29	<andrewbogott>	rebooting all worker nodes to pick up modprobe changes	[paws]
2026-04-28 §
09:46	<volans>	killed 22 zombies pods stuck in Terminating status since many days and with no running container/process	[paws]
2026-03-13 §
20:27	<andrew@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1)	[paws]
20:26	<andrew@cloudcumin1001>	START - Cookbook wmcs.vps.instance.stop_start vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1)	[paws]
20:00	<andrew@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.instance.stop_start (exit_code=0) vm paws-127c-uwce57bvcgrt-master-0 (cluster eqiad1)	[paws]
20:00	<andrew@cloudcumin1001>	START - Cookbook wmcs.vps.instance.stop_start vm paws-127c-uwce57bvcgrt-master-0 (cluster eqiad1)	[paws]
2026-03-09 §
08:31	<godog>	archive outdated https://gitlab.wikimedia.org/repos/cloud/paws in favor of github repo	[paws]
2025-12-24 §
17:21	<andrewbogott>	deleting everything in /srv/paws/files-to-remove T396051	[paws]
2025-12-23 §
10:56	<dhinus>	hard-reboot paws-127c-uwce57bvcgrt-node-1 (reporting NotReady in kubectl)	[paws]
2025-12-02 §
20:50	<andrewbogott>	stop/starting paws-127b-rpchztfjt2jb-node-1 to fix mtu mismatch	[paws]
20:00	<andrewbogott>	rebooting paws-127b-rpchztfjt2jb-master-0.paws to aid with host draining	[paws]
2025-11-19 §
09:32	<dcaro>	reboot worker 2 and 4	[paws]
09:32	<dcaro@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-4 (cluster eqiad1, project paws)	[paws]
09:32	<dcaro@cloudcumin1001>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-4 (cluster eqiad1, project paws)	[paws]
09:31	<dcaro@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-2 (cluster eqiad1, project paws)	[paws]
09:31	<dcaro@cloudcumin1001>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-2 (cluster eqiad1, project paws)	[paws]
09:31	<dcaro>	reboot worker 1	[paws]
09:29	<dcaro@cloudcumin1001>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-1 (cluster eqiad1, project paws)	[paws]
09:29	<dcaro@cloudcumin1001>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-1 (cluster eqiad1, project paws)	[paws]
2025-10-08 §
12:35	<godog>	very brief nfs interruption to wrap up T347681	[paws]
2025-10-02 §
09:27	<wmbot~dcaro@acme>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-4 (cluster eqiad1, project paws)	[paws]
09:27	<wmbot~dcaro@acme>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-4 (cluster eqiad1, project paws)	[paws]
09:26	<dcaro>	reboot node-4 (T406191)	[paws]
2025-09-26 §
09:17	<wmbot~dcaro@acme>	END (ERROR) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=255)	[paws]
2025-09-25 §
16:56	<wmbot~dcaro@acme>	START - Cookbook wmcs.openstack.cloudvirt.vm_console	[paws]
16:56	<wmbot~dcaro@acme>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-1 (cluster eqiad1, project paws)	[paws]
16:56	<wmbot~dcaro@acme>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-1 (cluster eqiad1, project paws)	[paws]
16:56	<wmbot~dcaro@acme>	END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0)	[paws]
16:50	<wmbot~dcaro@acme>	START - Cookbook wmcs.openstack.cloudvirt.vm_console	[paws]
2025-09-22 §
08:54	<wmbot~dcaro@acme>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1, project paws)	[paws]
08:53	<wmbot~dcaro@acme>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127c-uwce57bvcgrt-node-3 (cluster eqiad1, project paws)	[paws]
2025-09-18 §
19:37	<andrewbogott>	replaced previous deployment with new 127c deployment, supporting ssh access to VMs for T405023	[paws]
18:49	<andrew@cloudcumin1001>	END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0)	[paws]
18:49	<andrew@cloudcumin1001>	START - Cookbook wmcs.openstack.quota_increase	[paws]
18:48	<andrew@cloudcumin1001>	END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0)	[paws]
18:48	<andrew@cloudcumin1001>	START - Cookbook wmcs.openstack.quota_increase	[paws]
2025-09-15 §
17:19	<andrewbogott>	hard rebooting paws worker nodes one by one	[paws]
12:56	<dcaro>	restarting the k8s workers 1, 2 and 4	[paws]
12:56	<wmbot~dcaro@acme>	END (PASS) - Cookbook wmcs.vps.instance.force_reboot (exit_code=0) vm paws-127b-rpchztfjt2jb-node-4 (cluster eqiad1, project paws)	[paws]
12:56	<wmbot~dcaro@acme>	START - Cookbook wmcs.vps.instance.force_reboot vm paws-127b-rpchztfjt2jb-node-4 (cluster eqiad1, project paws)	[paws]