251-300 of 1054 results (18ms)
2021-02-26 §
14:25 <dcaro> [eqiad] rebooting cloudcephosd1010 for kernel upgrade (T275753) [admin]
14:17 <dcaro> [eqiad] rebooting cloudcephosd1009 for kernel upgrade (T275753) [admin]
13:54 <dcaro> [eqiad] downtimed alert1001 Ceph OSDs down alert until 18:00 GMT+1 as that is not under the host being rebooted (T275753) [admin]
13:51 <dcaro> [eqiad] rebooting cloudcephosd1008 for kernel upgrade (T275753) [admin]
13:45 <dcaro> [eqiad] rebooting cloudcephosd1007 for kernel upgrade (T275753) [admin]
13:38 <dcaro> [eqiad] rebooting cloudcephosd1006 for kernel upgrade (T275753) [admin]
12:07 <dcaro> [eqiad] rebooting cloudcephosd1005 for kernel upgrade (T275753) [admin]
12:00 <arturo> rebooting cloudcontrol1003 for kernel upgrade (T275753) [admin]
11:42 <arturo> rebooting cloudcontrol1004 for kernel upgrade (T275753) [admin]
11:41 <dcaro> [eqiad] rebooting cloudcephosd1004 for kernel upgrade (T275753) [admin]
11:32 <dcaro> [eqiad] rebooting cloudcephosd1003 for kernel upgrade (T275753) [admin]
11:30 <arturo> rebooting cloudcontrol1005 for kernel upgrade (T2 [admin]
11:26 <dcaro> [eqiad] rebooting cloudcephosd1002 for kernel upgrade (T275753) [admin]
11:16 <dcaro> [eqiad] rebooting cloudcephosd1001 for kernel upgrade (T275753) [admin]
11:11 <dcaro> [eqiad] rebooting cloudcephmon1003 for kernel upgrade (T275753) [admin]
11:05 <dcaro> [eqiad] rebooting cloudcephmon1002 for kernel upgrade (T275753) [admin]
10:59 <dcaro> [eqiad] rebooting cloudcephmon1001 for kernel upgrade (T275753) [admin]
10:45 <arturo> rebooting cloudvirt1039 into a new kernel (T275753) --- spare [admin]
10:43 <dcaro> [codfw1dev] rebooting cloudcephmon2003-dev for kernel upgrade (T275753) [admin]
10:38 <dcaro> [codfw1dev] rebooting cloudcephmon2002-dev for kernel upgrade (T275753) [admin]
10:29 <dcaro> [codfw1dev] rebooting cloudcephmon2001-dev for kernel upgrade (T275753) [admin]
10:24 <arturo> [codfw1dev] purge old kernel packages on cloudvirt2003-dev to force boot into a new kernel (T275753) [admin]
10:11 <arturo> [codfw1dev] manually creating /boot/grub/ on cloudvirt2003-dev to allow update-grub2 to run (so it can reboot into a new kernel) (T275753) [admin]
10:11 <dcaro> [codfw1dev] rebooting cloudcephosd2003-dev for kernel upgrade (T275753) [admin]
10:05 <dcaro> [codfw1dev] rebooting cloudcephosd2002-dev for kernel upgrade (T275753) [admin]
10:01 <arturo> [codfw1dev] rebooting cloudvirt200X-dev for kernel upgrade (T275753) [admin]
09:59 <arturo> [codfw1dev] rebooting cloudweb2001-dev for kernel upgrade (T275753) [admin]
09:53 <arturo> [codfw1dev] rebooting cloudservices2003-dev for kernel upgrade (T275753) [admin]
09:51 <arturo> [codfw1dev] rebooting cloudservices2002-dev for kernel upgrade (T275753) [admin]
09:45 <arturo> [codfw1dev] rebooting cloudcontrol2004-dev for kernel upgrade (T275753) [admin]
09:44 <arturo> [codfw1dev] rebooting cloudbackup[2001-2002].codfw.wmnet for kernel upgrade (T275753) [admin]
09:43 <dcaro> [codfw1dev] rebooting cloudcephosd2001-dev for kernel upgrade (T275753) [admin]
09:41 <arturo> [codfw1dev] rebooting cloudcontrol2003-dev for kernel upgrade (T275753) [admin]
09:33 <arturo> [codfw1dev] rebooting cloudcontrol2001-dev for kernel upgrade (T275753) [admin]
2021-02-25 §
14:56 <arturo> deployed wmcs-netns-events daemon to all cloudnet servers (T275483) [admin]
2021-02-24 §
11:07 <arturo> force-reboot cloudmetrics1002, add icinga downtime for 2 hours. Investigating some server issue [admin]
00:17 <bstorm> set --property hw_scsi_model=virtio-scsi and --property hw_disk_bus=scsi on the main stretch image in glance on eqiad1 T275430 [admin]
2021-02-23 §
22:43 <bstorm> set --property hw_scsi_model=virtio-scsi and --property hw_disk_bus=scsi on the main buster image in glance on eqiad1 T275430 [admin]
20:36 <andrewbogott> adding r/o access to the eqiad1-glance-images ceph pool for the client.eqiad1-compute for T275430 [admin]
10:49 <arturo> rebooting clounet1004 into new kernel from buster-bpo (T271058) [admin]
10:48 <arturo> installing linux-image-amd64 from buster-bpo 5.10.13-1~bpo10+1 in cloudnet1004 (T271058) [admin]
2021-02-22 §
17:14 <bstorm> restarting nova-compute on cloudvirt1016 and cloudvirt1036 in case it helps T275411 [admin]
15:02 <dcaro> Re-uploaded the debian buster 10.0 image from rbd to glance, that worked, re-spawning all the broken instances (T275378) [admin]
11:11 <dcaro> Refreshing all the canary instances (T275354) [admin]
2021-02-18 §
14:50 <arturo> rebooting cloudnet1004 for T271058 [admin]
10:25 <dcaro> Rebooting cloudmetrics1001 to apply new kernel (T275116) [admin]
10:16 <dcaro> Rebooting cloudmetrics1002 to apply new kernel (T275116) [admin]
10:14 <dcaro> Upgrading grafana on cloudmetrics1002 (T275116) [admin]
10:12 <dcaro> Upgrading grafana on cloudmetrics1001 (T275116) [admin]
2021-02-17 §
15:58 <arturo> deploying https://gerrit.wikimedia.org/r/c/operations/puppet/+/664845 to cloudnet servers (T268335) [admin]