351-400 of 802 results (17ms)
2021-06-24 §
14:24 <wm-bot> Adding a new k8s worker node - cookbook ran by dcaro@vulcanus [toolsbeta]
14:13 <wm-bot> Adding a new k8s worker node - cookbook ran by dcaro@vulcanus [toolsbeta]
2021-06-22 §
18:24 <majavah> rolling out kubernetes patch release 1.18.20, cluster is currently at 1.18.18 [toolsbeta]
2021-06-17 §
11:44 <majavah> toolsbeta-puppetdb-02: stop puppetdb to free up its ram usage, start postgres process, start puppetdb up again [toolsbeta]
2021-06-16 §
15:53 <majavah> add default security group rule allowing prometheus01.metricsinfra to connect to node-exporter port 9100 [toolsbeta]
2021-06-15 §
16:09 <majavah> set toolsbeta-bastion-05 as grid submit host [toolsbeta]
2021-06-14 §
21:29 <bstorm> deploy package with the staged patch to switch away from os.execv to QA in toolsbeta as toollabs-webservice version 0.75 T282975 [toolsbeta]
10:19 <arturo> deploying toolforge jobs-framework-api in kubernetes (just a test) (T283238) [toolsbeta]
2021-06-12 §
14:42 <majavah> sync hiera key prometheus_nodes to match tools [toolsbeta]
2021-06-11 §
15:25 <majavah> undeploy nginx-ingress-jobs from kubernetes [toolsbeta]
14:54 <majavah> generate and add own root key to passwords::root::extra_keys [toolsbeta]
2021-06-08 §
15:11 <majavah> updating k8s worker nodes to 1.18 T280299 [toolsbeta]
15:02 <majavah> continuing to update k8s ingress nodes T280299 [toolsbeta]
14:57 <majavah> continuing to update rest of k8s control nodes T280299 [toolsbeta]
14:42 <majavah> remove toolsbeta-test-k8s-etcd-[15,16] from kubernetes, instances do not exist, likely leftovers from local storage work [toolsbeta]
14:08 <majavah> update toolsbeta-test-k8s-control-4 to kubernetes 1.18 T280299 [toolsbeta]
2021-06-03 §
16:55 <majavah> renew ingress-admission-controller certificates T280301 [toolsbeta]
16:49 <majavah> renew registry-admission-webhook certificates T280301 [toolsbeta]
2021-05-25 §
17:14 <andrewbogott> deleting old ingress controllers toolsbeta-test-k8s-ingress-1 and toolsbeta-test-k8s-ingress-2 [toolsbeta]
17:13 <andrewbogott> created two new ingress nodes, toolsbeta-test-k8s-ingress-4 and toolsbeta-test-k8s-ingress-5 [toolsbeta]
15:09 <dcaro> turning off VM toolsbeta-test-k8s-etcd-14 to be able to reboot cloudvirt1020 [toolsbeta]
2021-05-24 §
19:40 <andrewbogott> replacing existing etcd nodes with localdisk nodes [toolsbeta]
2021-05-19 §
11:35 <Majavah> testing https://gerrit.wikimedia.org/r/c/operations/puppet/+/692875/ [toolsbeta]
06:51 <Majavah> depool toolsbeta-test-k8s-ingress-1 [toolsbeta]
2021-05-15 §
07:52 <Majavah> set profile::wmcs::kubeadm::control::apiserver_cert_alternative_names hiera key and adjust config map T262562 [toolsbeta]
2021-05-14 §
11:21 <arturo> allowed VIP address from the new port 172.16.3.26 into the ports of toolsbeta-redis-[1-3] (T153810) [toolsbeta]
11:16 <arturo> aborrero@cloudcontrol1005:~ $ sudo wmcs-openstack --os-project-id=toolsbeta port create --network lan-flat-cloudinstances2b toolsbeta-redis-vip (T153810) [toolsbeta]
2021-05-13 §
08:07 <Majavah> creating toolsbeta-redis-[1-3] as g3.cores1.ram2.disk20 to experiment with redis-sentinel / T153810 [toolsbeta]
2021-05-10 §
19:42 <bstorm> setting profile::wmcs::kubeadm::docker_vol: false on ingress nodes [toolsbeta]
17:43 <Majavah> testing https://gerrit.wikimedia.org/r/c/operations/puppet/+/688361 in toolsbeta T264221 [toolsbeta]
11:50 <Majavah> testing ingress-nginx update https://gerrit.wikimedia.org/r/c/operations/puppet/+/685715 on toolsbeta T264221 [toolsbeta]
2021-05-08 §
10:42 <Majavah> create new ingress node toolsbeta-k8s-ingress-3 T264221 [toolsbeta]
2021-05-07 §
17:00 <bstorm> deleted "toolsbeta-test-k8s-haproxy-2", "toolsbeta-test-k8s-haproxy-1" when the dns caches finally dropped T282227 [toolsbeta]
16:30 <bstorm> recreated k8s.toolsbeta.eqiad1.wikimedia.cloud. as a CNAME to k8s.svc.toolsbeta.eqiad1.wikimedia.cloud. T282227 [toolsbeta]
16:16 <Majavah> create record k8s.svc.toolsbeta.eqiad1.wikimedia.cloud. pointing to haproxy vip T282227 [toolsbeta]
14:20 <Majavah> cherry pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/686607/ [toolsbeta]
09:44 <arturo> `sudo wmcs-openstack --os-project-id=toolsbeta port create --network lan-flat-cloudinstances2b toolsbeta-k8s-haproxy-keepalived-vip` [toolsbeta]
08:19 <Majavah> rebuild toolsbeta-test-k8s-haproxy-[12] without nfs [toolsbeta]
2021-05-05 §
16:25 <Majavah> add self to sudo policy `roots` [toolsbeta]
16:07 <arturo> grant `taavi` projectadmin (Majavah) [toolsbeta]
2021-05-04 §
10:47 <arturo> rebase & resolve merge conflicts in labs/private.git [toolsbeta]
2021-05-03 §
13:23 <arturo> livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/684032 (T278109) [toolsbeta]
2021-04-29 §
18:10 <bstorm> added and removed an etcd node [toolsbeta]
2021-04-23 §
17:24 <bstorm> rebooting toolsbeta-test-k8s-control-6 because it was "notready" for some reason [toolsbeta]
2021-04-20 §
19:01 <bstorm> updated the maintain-kubeusers:beta image to https://gerrit.wikimedia.org/r/c/labs/tools/maintain-kubeusers/+/680244 [toolsbeta]
2021-04-13 §
16:41 <arturo> create VM toolsbeta-sgeexec-1002 (T277653) [toolsbeta]
15:44 <arturo> delete VMs toolsbeta-sgeexec-0903 and toolsbeta-buster-sgeexec-01 (no longer useful) [toolsbeta]
15:36 <arturo> created VM toolsbeta-sgeexec-0903 (buster) (T277653) [toolsbeta]
15:31 <arturo> live-hacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/678043/ (T277653) [toolsbeta]
2021-04-08 §
18:27 <bstorm> cleaned up the deprecated entries in /data/project/.system_sge/gridengine/etc/submithosts for toolsbeta-sgegrid-master and toolsbeta-sgegrid-shadow using the old fqdns T277653 [toolsbeta]