4901-4950 of 8002 results (45ms)
2022-10-13 §
12:19 <wm-bot2> OSDs (['cloudcephosd1027', 'cloudcephosd1028', 'cloudcephosd1029', 'cloudcephosd1030', 'cloudcephosd1031', 'cloudcephosd1032', 'cloudcephosd1033', 'cloudcephosd1034']) upgraded successfully B-) (T309786) - cookbook ran by dcaro@vulcanus [admin]
11:31 <wm-bot2> Upgrading OSDs and rebooting the nodes ['cloudcephosd1027', 'cloudcephosd1028', 'cloudcephosd1029', 'cloudcephosd1030', 'cloudcephosd1031', 'cloudcephosd1032', 'cloudcephosd1033', 'cloudcephosd1034'] (T309786) - cookbook ran by dcaro@vulcanus [admin]
11:30 <wm-bot2> OSDs (['cloudcephosd1025', 'cloudcephosd1026']) upgraded successfully B-) (T309786) - cookbook ran by dcaro@vulcanus [admin]
2022-10-10 §
14:01 <dcaro> test2 [admin]
01:22 <andrewbogott> restarting designate-sink on cloudservices100[45], possible example of T316614 [admin]
2022-10-09 §
12:04 <taavi> taavi@cloudweb1003 ~ $ mwscript extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=labswiki DatGuy # T320301 [admin]
2022-10-07 §
13:40 <andrewbogott> dhinus is resetting rabbitmq cluster in an attempt to resolve a suspected (by Andrew) split-brain [admin]
11:33 <arturo> rabbitmq-server.service @ cloudrabbit1002 is again up and running (T320232) [admin]
10:24 <arturo> stopping rabbitmq-server.service @ cloudrabbit1002 (T320232) [admin]
10:19 <arturo> restarting nova-conductor in all 3 cloudcontrols (T320232) [admin]
09:45 <arturo> restarting rabbitmq-server.service @ cloudrabbit1002 (T320232) [admin]
2022-10-06 §
15:55 <arturo> cloudnet1005 & cloudnet1006 now in service. Secom cloudnet1003 & cloudnet1004. Drop neutron agents, etc. (T316284) [admin]
11:54 <arturo> rebooting cloudnet1005/1006 to see if they have the right network config (T316284) [admin]
11:50 <arturo> set neutron l3 agents on cloudnet1005/1006 as down `root@cloudcontrol1005:~# neutron agent-update --admin-state-down <uuid>` (T316284) [admin]
11:40 <arturo> [codfw1dev] rebooting both network nodes to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/839492 [admin]
10:14 <arturo> [codfw1dev] restart neutron-l3-agent on cloudnet2006-dev, it was dead [admin]
2022-10-05 §
14:40 <wm-bot2> Adding OSD cloudcephosd1021.eqiad.wmnet... (1/1) (T319418) - cookbook ran by fran@wmf3169 [admin]
14:40 <wm-bot2> Adding new OSDs ['cloudcephosd1021.eqiad.wmnet'] to the cluster (T319418) - cookbook ran by fran@wmf3169 [admin]
14:28 <arturo> adding cloudinstances2b-gw router to l3 agents on cloudnet1005/1006 (T316284) [admin]
13:11 <wm-bot2> Added 1 new OSDs ['cloudcephosd1034.eqiad.wmnet'] (T314870) - cookbook ran by fran@wmf3169 [admin]
13:11 <wm-bot2> Added OSD cloudcephosd1034.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
13:02 <wm-bot2> Finished rebooting node cloudcephosd1034.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Rebooting node cloudcephosd1034.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Adding OSD cloudcephosd1034.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
12:58 <wm-bot2> Adding new OSDs ['cloudcephosd1034.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@wmf3169 [admin]
2022-10-04 §
16:40 <wm-bot2> Added 1 new OSDs ['cloudcephosd1033.eqiad.wmnet'] (T314870) - cookbook ran by fran@wmf3169 [admin]
16:40 <wm-bot2> Added OSD cloudcephosd1033.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
14:34 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) (T314870) - cookbook ran by fran@wmf3169 [admin]
14:30 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster (T314870) - cookbook ran by fran@wmf3169 [admin]
14:20 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
14:17 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
10:59 <wm-bot2> Finished rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
10:56 <wm-bot2> Rebooting node cloudcephosd1033.eqiad.wmnet - cookbook ran by fran@wmf3169 [admin]
10:55 <wm-bot2> Adding OSD cloudcephosd1033.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
10:55 <wm-bot2> Adding new OSDs ['cloudcephosd1033.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
2022-09-30 §
14:52 <wm-bot2> Added 1 new OSDs ['cloudcephosd1031.eqiad.wmnet'] - cookbook ran by fran@wmf3169 [admin]
14:52 <wm-bot2> Added OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:48 <wm-bot2> Adding OSD cloudcephosd1031.eqiad.wmnet... (1/1) - cookbook ran by fran@wmf3169 [admin]
14:48 <wm-bot2> Adding new OSDs ['cloudcephosd1031.eqiad.wmnet'] to the cluster - cookbook ran by fran@wmf3169 [admin]
14:16 <wm-bot2> Drained 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Set cloudvirt 'cloudvirt1023.eqiad.wmnet' maintenance (downtime id: 64eac5c6-4b1d-4269-98fd-8e5bed42ce40, use this to unset). (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Draining 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:15 <wm-bot2> Safe rebooting 'cloudvirt1023.eqiad.wmnet'. (T319025) - cookbook ran by andrew@buster [admin]
14:09 <wm-bot2> Drained 'cloudvirt1023.eqiad.wmnet'. - cookbook ran by andrew@buster [admin]
14:05 <wm-bot2> Set cloudvirt 'cloudvirt1023.eqiad.wmnet' maintenance (downtime id: fb99c967-b974-4314-a2fa-31ed0e883dd3, use this to unset). - cookbook ran by andrew@buster [admin]
14:04 <wm-bot2> Draining 'cloudvirt1023.eqiad.wmnet'. - cookbook ran by andrew@buster [admin]