51-100 of 4884 results (27ms)
2023-09-22 §
12:33 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.ceph.drain_node (exit_code=99) [admin]
12:33 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.drain_node [admin]
12:33 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.ceph.drain_node (exit_code=99) [admin]
12:28 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.drain_node [admin]
11:43 <wm-bot2> dcaro@urcuchillay END (FAIL) - Cookbook wmcs.ceph.drain_node (exit_code=99) [admin]
11:42 <wm-bot2> dcaro@urcuchillay START - Cookbook wmcs.ceph.drain_node [admin]
2023-09-21 §
16:35 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on tools-db-3.tools.eqiad1.wikimedia.cloud [admin]
16:34 <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.refresh_puppet_certs on tools-db-3.tools.eqiad1.wikimedia.cloud [admin]
02:12 <andrew@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.restart_openstack (exit_code=97) [admin]
02:12 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
2023-09-20 §
21:49 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
21:45 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
21:38 <root@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
21:35 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
21:34 <root@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) [admin]
21:31 <root@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
16:26 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
16:23 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
11:12 <arturo> moving openstack API endpoint to cloudlb (T346439) [admin]
10:28 <arturo> running SQL command `update domains set master="172.20.1.5:5354 172.20.2.4:5354 185.15.56.162:5354 185.15.56.163:5354";` on cloudservices1005/1006 (T346042) [admin]
10:06 <arturo> running SQL command `update domains set master="185.15.56.162:5354 185.15.56.163:5354"` on cloudservices1005/1005 (T346042) [admin]
2023-09-19 §
18:54 <andrewbogott> depooling clouddb1019 to let it recover from high memory use. T346826 [admin]
15:57 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
15:53 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
15:47 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.restart_openstack (exit_code=99) [admin]
15:46 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack [admin]
2023-09-18 §
11:53 <taavi> update designate urls in Keystone to point to openstack-next, until cloudlb is serving the main openstack address T346042 [admin]
11:40 <arturo> decomission cloudservices1005 T346042 in preparation for re-racking [admin]
08:44 <arturo> hardcode `185.15.56.161 openstack.eqiad1.wikimediacloud.org` in /etc/hosts in cloudcontrol1005 for T346441 [admin]
2023-09-15 §
11:43 <arturo> merging NAT change for T346426 in cloudgw [admin]
10:32 <arturo> faiolver cloudgw1001 into cloudgw1002, investigating a nftables syntax error (T346432) [admin]
2023-09-14 §
21:25 <wm-bot2> andrew@bullseye END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) [admin]
21:25 <wm-bot2> andrew@bullseye START - Cookbook wmcs.openstack.cloudvirt.drain [admin]
21:23 <wm-bot2> andrew@bullseye END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) [admin]
21:23 <wm-bot2> andrew@bullseye START - Cookbook wmcs.openstack.cloudvirt.drain [admin]
21:18 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) [admin]
21:18 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain [admin]
17:13 <wm-bot2> fran@wmf3169 admin END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) (T345810) [admin]
17:06 <wm-bot2> fran@wmf3169 START - Cookbook wmcs.openstack.cloudvirt.drain (T345810) [admin]
17:01 <wm-bot2> fran@wmf3169 admin END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) (T345810) [admin]
16:56 <wm-bot2> fran@wmf3169 START - Cookbook wmcs.openstack.cloudvirt.drain (T345810) [admin]
16:51 <wm-bot2> fran@wmf3169 admin END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) (T345810) [admin]
16:51 <wm-bot2> fran@wmf3169 START - Cookbook wmcs.openstack.cloudvirt.drain (T345810) [admin]
16:29 <wm-bot2> fran@wmf3169 admin END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) (T345810) [admin]
16:29 <wm-bot2> fran@wmf3169 START - Cookbook wmcs.openstack.cloudvirt.drain (T345810) [admin]
16:25 <fnegri@cloudcumin1001> END (ERROR) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=97) (T345810) [admin]
16:25 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.drain (T345810) [admin]
16:12 <topranks> DNS operation: remove old DNS entry for ns0.openstack.eqiad1.wikimediacloud.org. on wikimedia authdns (was pointing to 208.80.154.148) [admin]
16:10 <topranks> DNS operation: add new DNS entry for ns0.openstack.eqiad1.wikimediacloud.org. on wikimedia authdns pointing to 185.15.56.162 [admin]
14:42 <arturo> DNS operation: route 208.80.154.148 to cloudservices1006 in anticipation of cloudservices1005 decom (T346042) [admin]