1101-1150 of 1277 results (32ms)
2020-01-16 §
12:07 <arturo> live-hack tools-webservice in tools-sgebastion-04 to test https://gerrit.wikimedia.org/r/c/565259 (T242719) [toolsbeta]
2020-01-14 §
02:15 <andrewbogott> rebooting toolsbeta-sgecron-01 and toolsbeta-test-k8s-etcd-3 to get nfs unstuch [toolsbeta]
2020-01-13 §
16:41 <bstorm_> There was a filesystem unclean and other problems on the "old cluster" worker node 1001. Rebooting it in case that helps. [toolsbeta]
2020-01-10 §
21:05 <bstorm_> updated toollabs-webservice package to 0.55 for testing [toolsbeta]
2020-01-07 §
15:51 <bstorm_> changed kubeadm-config to use a list instead of a hash for extravols on the apiserver in the new k8s cluster T242067 [toolsbeta]
2020-01-06 §
21:42 <bstorm_> disabled rpcbind on toolsbeta-sgebastion-04 to test some things [toolsbeta]
2020-01-03 §
17:46 <bstorm_> stashed uncommitted changes on the puppetmaster because they seem to be things that are already merged [toolsbeta]
11:27 <arturo> [new k8s] cadvisor is running in the metrics namespace now (T237643) [toolsbeta]
2020-01-02 §
22:37 <bstorm_> Deleting the massive number of test ingresses for tool-fourohfour so the ingress controllers aren't moving so slowly. [toolsbeta]
22:19 <bstorm_> Changed the ingress-admission ValidatingWebhookConfiguration to check extensions as well as networking API groups [toolsbeta]
2019-12-17 §
00:14 <bstorm_> Fully enabled encryption at rest for toolsbeta kubernetes [toolsbeta]
2019-12-16 §
23:03 <bstorm_> updated the kubeadm-config configmap to match the new init file [toolsbeta]
2019-12-04 §
13:02 <arturo> drop puppet prefix `toolsbeta-grid-master`, deprecated and no longer in use [toolsbeta]
12:50 <arturo> drop puppet prefix `toolsbeta-bastion`, deprecated and no longer in use [toolsbeta]
2019-12-02 §
10:38 <arturo> create wildcard DNS record for `*.toolsbeta.wmflabs.org` for use by the new k8s cluster [toolsbeta]
10:34 <arturo> manually scale nginx-ingress deployment to 5 replicas (T239405) [toolsbeta]
2019-11-25 §
10:30 <arturo> add puppet cert SANs via hiera to toolsbeta-test-k8s-etcd nodes (T238655) [toolsbeta]
2019-11-21 §
14:15 <arturo> upgrade new k8s cluster to 1.15.6 using kubeadm (plus kubelet) [toolsbeta]
2019-11-15 §
14:46 <arturo> stop live-hacks on toolsbeta-test-k8s-haproxy-1 T237643 [toolsbeta]
2019-11-14 §
10:32 <arturo> live-hacking toolsbeta-test-k8s-haproxy-1 to point to just the k8s apiserver in control-1 Turn on --v=10 in control-1 for extended debug [toolsbeta]
2019-11-08 §
19:36 <bstorm_> rebooted the proxy server just in case that fixes something. [toolsbeta]
11:58 <arturo> adding `profile::toolforge::bastion::nproc: 100` to puppet prefix `toolsbeta-sgebastion` (T236202) [toolsbeta]
11:38 <arturo> new k8s: refresh deployment for nginx-ingress with latest changes from puppet [toolsbeta]
2019-11-07 §
21:55 <bstorm_> killed pods for ingress admission controller to upgrade to new image T215531 [toolsbeta]
2019-11-06 §
22:39 <bstorm_> upgraded repo version of toollabs-webservice in toolsbeta-stretch to 0.49 -- changes for the new k8s cluster T215531 [toolsbeta]
19:09 <bstorm_> added profile::toolforge::proxies in global hiera to try and figure out why it won't let anything use redis T237443 [toolsbeta]
18:53 <bstorm_> launching toolsbeta-proxy-2 on a hunch that the config doesn't work well as a standalone T237443 [toolsbeta]
18:46 <bstorm_> rebooting toolsbeta-proxy-1 trying to convince redis it is not a read replica T237443 [toolsbeta]
18:29 <bstorm_> stopped broken kube-proxy service on toolsbeta-proxy-1 (should probably be puppetized) [toolsbeta]
17:35 <bstorm_> changing some hiera to work with new proxy host [toolsbeta]
12:44 <arturo> created VM toolsbeta-proxy-1 (T237443) [toolsbeta]
2019-11-05 §
22:50 <bstorm_> deployed the new maintain-kubeusers to toolsbeta T215531 T228499 [toolsbeta]
2019-10-25 §
23:41 <bstorm_> Deployed custom webhook controllers for registry and ingress checking to toolsbeta-test kubernetes cluster T215531 T215678 T234231 [toolsbeta]
16:15 <bstorm_> rebooting toolsbeta-test-k8s-worker-1 and -2 [toolsbeta]
2019-10-23 §
12:04 <arturo> created 2 new VMs `toolsbeta-test-k8s-worker-[1,2]` T236074 [toolsbeta]
11:56 <arturo> point FQDN `k8s.toolsbeta.eqiad1.wikimedia.cloud` to `toolsbeta-test-k8s-haproxy-1` (T236074) [toolsbeta]
11:19 <arturo> re-create VM `toolsbeta-test-k8s-haproxy-1` to use new puppet profile (T236074) [toolsbeta]
11:10 <arturo> re-create VM `toolsbeta-test-k8s-haproxy-2` to test https://gerrit.wikimedia.org/r/545532 (T236074) [toolsbeta]
2019-10-22 §
17:43 <arturo> re-create VM `toolsbeta-test-k8s-control-1` T236074 [toolsbeta]
15:48 <arturo> point DNS record `k8s.toolsbeta.eqiad1.wikimedia.cloud` to the first controller node for the bootstrap T236074 [toolsbeta]
15:30 <arturo> created puppet prefix `toolsbeta-test-k8s-control` and delete `toolsbeta-test-k8s-master` T236074 [toolsbeta]
12:27 <arturo> refreshed puppet prefix `toolsbeta-test-k8s-control` with latest info T236074 [toolsbeta]
12:26 <arturo> created 3 VMs `toolsbeta-test-k8s-control-{1,2,3}` T236074 [toolsbeta]
12:15 <arturo> refresh IP addr of FQDN `k8s.toolsbeta.eqiad1.wikimedia.cloud` T236074 [toolsbeta]
12:14 <arturo> delete FQDN `toolsbeta-k8s-master.toolsbeta.wmflabs.org` T236074 [toolsbeta]
11:57 <arturo> created 2 new VMS `toolsbeta-test-k8s-haproxy-{1,2}` T236074 [toolsbeta]
11:54 <arturo> created puppet prefix `toolsbeta-test-k8s-haproxy` and delete `toolsbeta-test-k8s-lb` T236074 [toolsbeta]
2019-10-21 §
15:13 <arturo> refresh config in prefix puppet `toolsbeta-test-k8s-etcd` to account for new servers T236074 [toolsbeta]
15:07 <arturo> create 3 VMs toolsbeta-test-k8s-etcd-{1,2,3} T236074 [toolsbeta]
14:58 <arturo> deleting all toolsbeta-test-* VMs (master, worker, etcd, lb) T236074 [toolsbeta]