1-50 of 10000 results (7ms)
2026-11-04 §
10:11 <volans> truncating large uwsgi log files on Toolforge NFS as it is getting too full. Leaving the last 10k lines in each of them. [admin]
08:28 <godog> roll-reboot cloudgws [admin]
08:14 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.roll_reboot_cloudnets (exit_code=0) [admin]
08:02 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.roll_reboot_cloudnets [admin]
2026-11-03 §
18:38 <volans> starting job files logs truncate on NFS as per https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull [admin]
2026-11-02 §
08:38 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T431374) [admin]
08:38 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T431374) [admin]
08:03 <godog> put cloudvirtlocal1001 back in service [admin]
08:03 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
08:03 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
2026-10-30 §
10:51 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [admin]
10:50 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [admin]
10:50 <godog> put back cloudvirt1050 in service [admin]
2026-10-28 §
16:57 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
16:56 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:55 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/370 [admin]
16:55 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/370 [admin]
16:49 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/370 [admin]
16:49 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/370 [admin]
16:46 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
16:45 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:22 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
16:22 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:20 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
16:20 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:18 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
16:18 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:16 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
16:16 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
16:15 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/369 [admin]
16:15 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/369 [admin]
2026-10-27 §
14:41 <andrewbogott> openstack role add --project paws --user magnum secgroupadmin T442554 [admin]
14:41 <andrewbogott> "openstack role create secgroupadmin" for T442554 [admin]
09:25 <taavi> restore Horizon access [admin]
2026-10-23 §
16:53 <dcaro> started toolsadmin/striked back again [admin]
2026-10-20 §
19:24 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_osds (exit_code=0) (T441652) [admin]
18:35 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudservices.safe_reboot (exit_code=0) on hosts matched by 'P{O:wmcs::openstack::eqiad1::services}' [admin]
18:28 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudservices.safe_reboot on hosts matched by 'P{O:wmcs::openstack::eqiad1::services}' [admin]
16:15 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_osds (T441652) [admin]
16:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.ceph.roll_reboot_mons (exit_code=0) (T441652) [admin]
15:45 <andrew@cloudcumin1001> START - Cookbook wmcs.ceph.roll_reboot_mons (T441652) [admin]
12:46 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudweb.safe_reboot (exit_code=0) on hosts matched by 'P{O:wmcs::openstack::eqiad1::cloudweb}' [admin]
12:41 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudweb.safe_reboot on hosts matched by 'P{O:wmcs::openstack::eqiad1::cloudweb}' [admin]
11:41 <filippo@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=99) on hosts matched by 'D{cloudvirtlocal1001} AND NOT P{F:kernelversion = 6.6.6}' [admin]
11:41 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirtlocal1001} AND NOT P{F:kernelversion = 6.6.6}' [admin]
11:27 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudlb.safe_reboot (exit_code=0) on hosts matched by 'A:cloudlb AND A:eqiad' [admin]
11:21 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudlb.safe_reboot on hosts matched by 'A:cloudlb AND A:eqiad' [admin]
09:35 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudcontrol.reboot_node (exit_code=0) on hosts matched by 'P{O:wmcs::openstack::eqiad1::control}' [admin]
09:22 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.cloudcontrol.reboot_node on hosts matched by 'P{O:wmcs::openstack::eqiad1::control}' [admin]
2026-10-19 §
21:32 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) (T431374) [admin]