2751-2800 of 4096 results (22ms)
2022-02-03 §
08:21 <taavi> cloudmetrics1004: manually added an empty line to /etc/prometheus/blackbox.yml to make /usr/local/bin/blackbox-exporter-assemble happy (clearing "performing a change every puppet run" alert) [admin]
2022-02-02 §
02:36 <andrewbogott> restarting mariadb on cloudcontrol1004 [admin]
2022-01-31 §
10:15 <arturo> cloudcontrol1005:~$ sudo systemctl restart backup_glance_images.service (failed state, no logs, icinga alert) [admin]
2022-01-29 §
18:24 <taavi> delete 2 puppet prefixes in a weird state T299750 [admin]
2022-01-27 §
13:24 <arturo> cloudmetrics1004:~ $ sudo systemctl restart wmcs_monitoring_graphite_rsync.service (T300138) [admin]
2022-01-26 §
19:09 <andrewbogott> bootstrapping a fresh galera node on cloudcontrol1004 [admin]
18:57 <andrewbogott> restarting mariadb on cloudcontrol1004 [admin]
2022-01-25 §
10:49 <arturo> made cloudmetrics1001/1002 primary/backup respectively (T299744, T297814, T300011) [admin]
2022-01-19 §
16:38 <andrewbogott> moving all scratch mounts to scratch.svc.cloudinfra-nfs.eqiad1.wikimedia.cloud [admin]
2022-01-05 §
03:11 <andrewbogott> 'cp /etc/apt/sources.list /etc/apt/sources.list.prepuppet' on all VMs. Backing up state before puppetizing sources.list with https://gerrit.wikimedia.org/r/c/operations/puppet/+/751498 [admin]
2022-01-04 §
12:44 <dcaro> increasing the size_limit for labs ldap servers [admin]
2021-12-26 §
16:55 <majavah> run attachLdapUser.php on wikitech for developer account "Karthiksripal" [admin]
2021-12-24 §
22:51 <majavah> ran the wikireplica dns script on s5 T298303 [admin]
2021-12-23 §
21:42 <majavah> deployed horizon wmf-proxy-dashboard update to fix editing of existing proxies [admin]
2021-12-21 §
10:39 <arturo> dropped egress NAT exceptions for WMF apt repos, T298042 [admin]
2021-12-15 §
12:44 <dcaro> Downtiming cloudvirt-wdqs1001 as it has no VMs running until disk space is fixed (T297454) [admin]
2021-12-14 §
10:26 <dcaro> Moved the nova cache (/var/lib/nova/instances/_base) and the canary image local data (/var/lib/nova/instance/<canary_image_id>) to the root disk on cloudvirt-wdqs1001 to temporary free some space (T297454) [admin]
2021-12-13 §
18:08 <wm-bot> Drained 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:50 <wm-bot> Set cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Setting cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Draining 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:44 <wm-bot> Drained 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Set cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Setting cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Draining 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:13 <wm-bot> Drained 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:50 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Draining 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:44 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:43 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
2021-12-03 §
18:56 <andrewbogott> maintain-views and maintain-meta-p on clouddb1013-1020 [admin]
10:49 <majavah> deleting dbbackups-dashboard project T296992 [admin]
2021-12-02 §
01:17 <wm-bot> Drained 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Set cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Setting cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Draining 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Set cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Setting cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Draining 'cloudvirt1026.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:28 <wm-bot> Drained 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:03 <wm-bot> Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:02 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:02 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
2021-12-01 §
23:59 <wm-bot> Setting cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
23:59 <wm-bot> Draining 'cloudvirt1021.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
23:54 <andrewbogott> *correction* adding spare cloudvirts 1044 and 1045 to the 'ceph' pool in order to make space for future juggling around T296790 and T296792 [admin]
23:53 <andrewbogott> adding spare cloudvirts 1044 and 1055 to the 'ceph' pool in order to make space for future juggling around T296790 and T296792 [admin]
2021-11-28 §
17:48 <andrewbogott> moved cloudvirt1018 out of the 'localstorage' aggregate and into 'maintenance' for T296592. It will need to be moved back after the raid is rebuilt. [admin]
2021-11-21 §
07:19 <dcaro_away> restarting designate-sink with some extra logs in it (T296144) [admin]