4601-4650 of 6010 results (23ms)
2022-03-14 §
18:55 <wm-bot> Draining 'cloudvirt1023.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
18:53 <wm-bot> Drained 'cloudvirt1022.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
18:52 <wm-bot> Set cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:51 <wm-bot> Setting cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:51 <wm-bot> Draining 'cloudvirt1022.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
16:50 <wm-bot> Drained 'cloudvirt1021.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
16:48 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:48 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:48 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
11:48 <dcaro> rebased cookbooks on latest master, make sure you pull before sending new patches [admin]
2022-03-08 §
18:29 <wm-bot> Set cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:29 <wm-bot> Setting cloudvirt 'cloudvirt1022.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:29 <wm-bot> Draining 'cloudvirt1022.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
18:23 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:21 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:21 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
18:18 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:17 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
18:17 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
17:28 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
17:27 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
17:27 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
17:18 <wm-bot> Set cloudvirt 'cloudvirt1017.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
17:15 <wm-bot> Setting cloudvirt 'cloudvirt1017.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
17:15 <wm-bot> Draining 'cloudvirt1017.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
16:48 <wm-bot> Set cloudvirt 'cloudvirt1017.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:47 <wm-bot> Setting cloudvirt 'cloudvirt1017.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:47 <wm-bot> Draining 'cloudvirt1017.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
16:36 <wm-bot> Drained 'cloudvirt1016.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
16:08 <wm-bot> Set cloudvirt 'cloudvirt1016.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:07 <wm-bot> Setting cloudvirt 'cloudvirt1016.eqiad.wmnet' maintenance. (T281276) - cookbook ran by andrew@buster [admin]
16:07 <wm-bot> Draining 'cloudvirt1016.eqiad.wmnet'. (T281276) - cookbook ran by andrew@buster [admin]
13:11 <arturo> [codfw1dev] rebooting cloudservices servers for T303179 [admin]
13:07 <arturo> [codfw1dev] rebooting cloudvirt servers for T303179 [admin]
13:06 <arturo> [codfw1dev] rebooting cloudnet servers for T303179 [admin]
12:55 <arturo> [codfw1dev] rebooting cloudcontrol servers for T303179 [admin]
2022-03-03 §
08:49 <taavi> deploying cloudmetrics grafana to grafana 8, T282863 [admin]
2022-03-02 §
09:06 <arturo> merging core router firewall change https://gerrit.wikimedia.org/r/c/operations/homer/public/+/701347 [admin]
2022-02-28 §
15:30 <dcaro> cleaning up leftover snapshots from failed backups of the maps volume (T302720) [admin]
2022-02-24 §
17:04 <andrewbogott> upgrading eqiad1 and codfw1dev to mariadb 10.5.15+maria~bullseye via 'apt-get install libmariadb3:amd64 galera-4 mariadb-server' [admin]
15:42 <dcaro> stopping and starting mariadb on cloudcontrol1003 (T302146) [admin]
10:37 <arturo> [codfw1dev] briefly installed galera-4 (26.4.11+1bullseye) over (26.4.9-0+deb11u1) on cloudcontrol2001-dev and then downgrade again to verify package install (T302482) [admin]
2022-02-23 §
20:39 <taavi> added domain-wide 'designateadmin' and 'observer' roles to project-proxy-dns-manager service account T295246 [admin]
17:40 <andrewbogott> restarting lots of openstack services to try to clear up the mess that is T236101 [admin]
12:13 <arturo> cleaning up cinder volume snapshots, aborrero@cloudcontrol1005:~$ for i in $(sudo wmcs-openstack volume snapshot list -f value -c ID) ; do sudo wmcs-openstack volume snapshot delete $i ; done (T302382) [admin]
10:14 <arturo> cleaning up neutron agents for non-existent servers cloudvirt100[1-9].eqiad.wmnet,cloudvirt10[12-15].eqiad.wmnet [admin]
10:05 <dcaro> Deleting stuck novafullstack servers, to let the service create new ones (T302369) [admin]
09:56 <arturo> neutron agent-delete bad663b3-fd25-4393-a546-4b1b4bdec4db (Linux bridge agent | cloudvirtan1001) [admin]
09:56 <arturo> neutron agent-delete 1071c198-ed57-4b5a-9439-30e66a31aa69 (Linux bridge agent | cloudvirtan1005) [admin]
09:55 <arturo> neutron agent-delete 2eeef198-8af7-4e5d-bd73-e14a2a8d2404 (Linux bridge agent | cloudvirtan1004) [admin]