1-50 of 443 results (18ms)
2021-06-11 §
15:25 <majavah> undeploy nginx-ingress-jobs from kubernetes [toolsbeta]
14:54 <majavah> generate and add own root key to passwords::root::extra_keys [toolsbeta]
2021-06-08 §
15:11 <majavah> updating k8s worker nodes to 1.18 T280299 [toolsbeta]
15:02 <majavah> continuing to update k8s ingress nodes T280299 [toolsbeta]
14:57 <majavah> continuing to update rest of k8s control nodes T280299 [toolsbeta]
14:42 <majavah> remove toolsbeta-test-k8s-etcd-[15,16] from kubernetes, instances do not exist, likely leftovers from local storage work [toolsbeta]
14:08 <majavah> update toolsbeta-test-k8s-control-4 to kubernetes 1.18 T280299 [toolsbeta]
2021-06-03 §
16:55 <majavah> renew ingress-admission-controller certificates T280301 [toolsbeta]
16:49 <majavah> renew registry-admission-webhook certificates T280301 [toolsbeta]
2021-05-25 §
17:14 <andrewbogott> deleting old ingress controllers toolsbeta-test-k8s-ingress-1 and toolsbeta-test-k8s-ingress-2 [toolsbeta]
17:13 <andrewbogott> created two new ingress nodes, toolsbeta-test-k8s-ingress-4 and toolsbeta-test-k8s-ingress-5 [toolsbeta]
15:09 <dcaro> turning off VM toolsbeta-test-k8s-etcd-14 to be able to reboot cloudvirt1020 [toolsbeta]
2021-05-24 §
19:40 <andrewbogott> replacing existing etcd nodes with localdisk nodes [toolsbeta]
2021-05-19 §
11:35 <Majavah> testing https://gerrit.wikimedia.org/r/c/operations/puppet/+/692875/ [toolsbeta]
06:51 <Majavah> depool toolsbeta-test-k8s-ingress-1 [toolsbeta]
2021-05-15 §
07:52 <Majavah> set profile::wmcs::kubeadm::control::apiserver_cert_alternative_names hiera key and adjust config map T262562 [toolsbeta]
2021-05-14 §
11:21 <arturo> allowed VIP address from the new port 172.16.3.26 into the ports of toolsbeta-redis-[1-3] (T153810) [toolsbeta]
11:16 <arturo> aborrero@cloudcontrol1005:~ $ sudo wmcs-openstack --os-project-id=toolsbeta port create --network lan-flat-cloudinstances2b toolsbeta-redis-vip (T153810) [toolsbeta]
2021-05-13 §
08:07 <Majavah> creating toolsbeta-redis-[1-3] as g3.cores1.ram2.disk20 to experiment with redis-sentinel / T153810 [toolsbeta]
2021-05-10 §
19:42 <bstorm> setting profile::wmcs::kubeadm::docker_vol: false on ingress nodes [toolsbeta]
17:43 <Majavah> testing https://gerrit.wikimedia.org/r/c/operations/puppet/+/688361 in toolsbeta T264221 [toolsbeta]
11:50 <Majavah> testing ingress-nginx update https://gerrit.wikimedia.org/r/c/operations/puppet/+/685715 on toolsbeta T264221 [toolsbeta]
2021-05-08 §
10:42 <Majavah> create new ingress node toolsbeta-k8s-ingress-3 T264221 [toolsbeta]
2021-05-07 §
17:00 <bstorm> deleted "toolsbeta-test-k8s-haproxy-2", "toolsbeta-test-k8s-haproxy-1" when the dns caches finally dropped T282227 [toolsbeta]
16:30 <bstorm> recreated k8s.toolsbeta.eqiad1.wikimedia.cloud. as a CNAME to k8s.svc.toolsbeta.eqiad1.wikimedia.cloud. T282227 [toolsbeta]
16:16 <Majavah> create record k8s.svc.toolsbeta.eqiad1.wikimedia.cloud. pointing to haproxy vip T282227 [toolsbeta]
14:20 <Majavah> cherry pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/686607/ [toolsbeta]
09:44 <arturo> `sudo wmcs-openstack --os-project-id=toolsbeta port create --network lan-flat-cloudinstances2b toolsbeta-k8s-haproxy-keepalived-vip` [toolsbeta]
08:19 <Majavah> rebuild toolsbeta-test-k8s-haproxy-[12] without nfs [toolsbeta]
2021-05-05 §
16:25 <Majavah> add self to sudo policy `roots` [toolsbeta]
16:07 <arturo> grant `taavi` projectadmin (Majavah) [toolsbeta]
2021-05-04 §
10:47 <arturo> rebase & resolve merge conflicts in labs/private.git [toolsbeta]
2021-05-03 §
13:23 <arturo> livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/684032 (T278109) [toolsbeta]
2021-04-29 §
18:10 <bstorm> added and removed an etcd node [toolsbeta]
2021-04-23 §
17:24 <bstorm> rebooting toolsbeta-test-k8s-control-6 because it was "notready" for some reason [toolsbeta]
2021-04-20 §
19:01 <bstorm> updated the maintain-kubeusers:beta image to https://gerrit.wikimedia.org/r/c/labs/tools/maintain-kubeusers/+/680244 [toolsbeta]
2021-04-13 §
16:41 <arturo> create VM toolsbeta-sgeexec-1002 (T277653) [toolsbeta]
15:44 <arturo> delete VMs toolsbeta-sgeexec-0903 and toolsbeta-buster-sgeexec-01 (no longer useful) [toolsbeta]
15:36 <arturo> created VM toolsbeta-sgeexec-0903 (buster) (T277653) [toolsbeta]
15:31 <arturo> live-hacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/678043/ (T277653) [toolsbeta]
2021-04-08 §
18:27 <bstorm> cleaned up the deprecated entries in /data/project/.system_sge/gridengine/etc/submithosts for toolsbeta-sgegrid-master and toolsbeta-sgegrid-shadow using the old fqdns T277653 [toolsbeta]
2021-04-06 §
13:11 <dcaro> Removing etcd member toolsbeta-test-k8s-etcd-7.tools.eqiad1.wikimedia.cloud to get an odd number (T267082) [toolsbeta]
2021-04-01 §
15:17 <dcaro> etcd cluster shrunk 3 members (using wmcs.toolforge.remove_etcd_node cookbook) [toolsbeta]
14:54 <dcaro> shrinking etcd cluster to 3 members, cleaning up automation runs [toolsbeta]
2021-03-31 §
18:22 <bstorm> redeploy ingress-admission controller with `kubectl apply -k deploys/toolsbeta` from the repo T275478 [toolsbeta]
2021-03-24 §
12:17 <arturo> attach the `toolsbeta-docker-registry-data` volume to the `toolsbeta-docker-registry-02` VM [toolsbeta]
11:41 <arturo> created VM toolsbeta-docker-registry-02 as Debian buster (T278303) [toolsbeta]
11:34 <arturo> attached cinder volume `toolsbeta-docker-registry-data` as /dev/vdb on toolsbeta-docker-registry-01 [toolsbeta]
11:23 <arturo> created 2G cinder volume `toolsbeta-docker-registry-data` (T278303) [toolsbeta]
2021-03-23 §
11:22 <arturo> drop and build again the VM toolsbeta-sgregrid-master (T277653) [toolsbeta]