151-200 of 1507 results (21ms)
2022-02-23 §
09:38 <dcaro> restarting neutron-dhcp-agent on cloudnet1003 (T302369) [admin]
2022-02-22 §
22:10 <andrewbogott> raising project 'maps' quota by two tb -- T300160 [admin]
09:24 <arturo> restarting mariadb @ cloudcontrol1003 (T302146) [admin]
09:13 <arturo> restarting mariadb @ cloudcontrol1004 (T302146) [admin]
2022-02-18 §
21:57 <andrewbogott> leaving cloudcontrol1003 downtimed with disabled puppet for the weekend. Everything there should be stable and fine save rabbit which needs an upgrade. [admin]
21:30 <andrewbogott> rebooting cloudcontrol1003 because rabbit is freaking out [admin]
17:25 <andrewbogott> in-place upgrade of cloudcontrol1004 to bullseye -- T281276 [admin]
12:34 <arturo> manually install prometheus-openstack-exporter on cloudcontrol1005 (T302050) [admin]
2022-02-17 §
23:02 <andrewbogott> in-place upgrade to Bullseye on cloudcontrol1005 T281276 [admin]
2022-02-15 §
14:15 <taavi> [codfw1dev] added domain-wide 'designateadmin' and 'observer' roles to codfw1dev-proxy-dns-manager service account T295246 [admin]
2022-02-04 §
10:12 <arturo> restart backup_vms service in cloudvirt1024 (T300956) [admin]
2022-02-03 §
08:21 <taavi> cloudmetrics1004: manually added an empty line to /etc/prometheus/blackbox.yml to make /usr/local/bin/blackbox-exporter-assemble happy (clearing "performing a change every puppet run" alert) [admin]
2022-02-02 §
02:36 <andrewbogott> restarting mariadb on cloudcontrol1004 [admin]
2022-01-31 §
10:15 <arturo> cloudcontrol1005:~$ sudo systemctl restart backup_glance_images.service (failed state, no logs, icinga alert) [admin]
2022-01-29 §
18:24 <taavi> delete 2 puppet prefixes in a weird state T299750 [admin]
2022-01-27 §
13:24 <arturo> cloudmetrics1004:~ $ sudo systemctl restart wmcs_monitoring_graphite_rsync.service (T300138) [admin]
2022-01-26 §
19:09 <andrewbogott> bootstrapping a fresh galera node on cloudcontrol1004 [admin]
18:57 <andrewbogott> restarting mariadb on cloudcontrol1004 [admin]
2022-01-25 §
10:49 <arturo> made cloudmetrics1001/1002 primary/backup respectively (T299744, T297814, T300011) [admin]
2022-01-19 §
16:38 <andrewbogott> moving all scratch mounts to scratch.svc.cloudinfra-nfs.eqiad1.wikimedia.cloud [admin]
2022-01-05 §
03:11 <andrewbogott> 'cp /etc/apt/sources.list /etc/apt/sources.list.prepuppet' on all VMs. Backing up state before puppetizing sources.list with https://gerrit.wikimedia.org/r/c/operations/puppet/+/751498 [admin]
2022-01-04 §
12:44 <dcaro> increasing the size_limit for labs ldap servers [admin]
2021-12-26 §
16:55 <majavah> run attachLdapUser.php on wikitech for developer account "Karthiksripal" [admin]
2021-12-24 §
22:51 <majavah> ran the wikireplica dns script on s5 T298303 [admin]
2021-12-23 §
21:42 <majavah> deployed horizon wmf-proxy-dashboard update to fix editing of existing proxies [admin]
2021-12-21 §
10:39 <arturo> dropped egress NAT exceptions for WMF apt repos, T298042 [admin]
2021-12-15 §
12:44 <dcaro> Downtiming cloudvirt-wdqs1001 as it has no VMs running until disk space is fixed (T297454) [admin]
2021-12-14 §
10:26 <dcaro> Moved the nova cache (/var/lib/nova/instances/_base) and the canary image local data (/var/lib/nova/instance/<canary_image_id>) to the root disk on cloudvirt-wdqs1001 to temporary free some space (T297454) [admin]
2021-12-13 §
18:08 <wm-bot> Drained 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:50 <wm-bot> Set cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Setting cloudvirt 'cloudvirt1014.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:49 <wm-bot> Draining 'cloudvirt1014.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:44 <wm-bot> Drained 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Set cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Setting cloudvirt 'cloudvirt1013.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
17:30 <wm-bot> Draining 'cloudvirt1013.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
17:13 <wm-bot> Drained 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:50 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:47 <wm-bot> Draining 'cloudvirt1012.eqiad.wmnet'. - cookbook ran by michael@mouse [admin]
16:44 <wm-bot> Set cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
16:43 <wm-bot> Setting cloudvirt 'cloudvirt1012.eqiad.wmnet' maintenance. - cookbook ran by michael@mouse [admin]
2021-12-03 §
18:56 <andrewbogott> maintain-views and maintain-meta-p on clouddb1013-1020 [admin]
10:49 <majavah> deleting dbbackups-dashboard project T296992 [admin]
2021-12-02 §
01:17 <wm-bot> Drained 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Set cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Setting cloudvirt 'cloudvirt1028.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:56 <wm-bot> Draining 'cloudvirt1028.eqiad.wmnet'. (T296790) - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Set cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]
00:50 <wm-bot> Setting cloudvirt 'cloudvirt1026.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [admin]