1-50 of 3681 results (27ms)
2023-03-06 §
12:51 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/registry-admission-webhook (6688477) - cookbook ran by taavi@runko [tools]
12:33 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/registry-admission:e916fee from https://gerrit.wikimedia.org/r/labs/tools/registry-admission-webhook (e916fee) - cookbook ran by taavi@runko [tools]
12:16 <arturo> delete calico deployment, redeploy from https://gitlab.wikimedia.org/repos/cloud/toolforge/calico (T328539) [tools]
2023-03-05 §
15:43 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (3e04025) - cookbook ran by taavi@runko [tools]
2023-03-02 §
11:32 <arturo> aborrero@tools-k8s-control-2:~$ sudo -i kubectl apply -f /etc/kubernetes/toolforge-tool-roles.yaml (https://gerrit.wikimedia.org/r/c/operations/puppet/+/889836) [tools]
2023-03-01 §
13:18 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (13eda9d) - cookbook ran by taavi@runko [tools]
2023-02-28 §
17:19 <wm-bot2> deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway (9252af7) - cookbook ran by taavi@runko [tools]
17:04 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (e46da83) - cookbook ran by taavi@runko [tools]
2023-02-23 §
18:07 <wm-bot2> deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway (efb60b3) - cookbook ran by taavi@runko [tools]
09:33 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/buildpack-admission:b34e2f8 from https://github.com/toolforge/buildpack-admission-controller.git (b34e2f8) - cookbook ran by taavi@runko [tools]
2023-02-21 §
09:37 <arturo> hard-reboot tools-sgeexec-10-11 (unresponsive to ssh) [tools]
2023-02-20 §
11:24 <taavi> redeploy volume-admission with helm and cert-manager certificates T329530 T292238 [tools]
11:15 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/volume-admission:7fd13ac from https://gerrit.wikimedia.org/r/cloud/toolforge/volume-admission-controller (ede8bd0) - cookbook ran by taavi@runko [tools]
11:05 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-volume-admission-controller:7fd13ac from https://gerrit.wikimedia.org/r/cloud/toolforge/volume-admission-controller (7fd13ac) - cookbook ran by taavi@runko [tools]
10:39 <wm-bot2> Increased quotas by 4000 gigabytes - cookbook ran by fran@wmf3169 [tools]
09:20 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@nostromo [tools]
2023-02-19 §
09:16 <taavi> uncordon tools-k8s-worker-[80-82] after fixing security groups T329378 [tools]
2023-02-17 §
11:32 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (eeeea4c) - cookbook ran by arturo@endurance [tools]
11:31 <wm-bot2> deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/image-config (7729b18) (T254636) - cookbook ran by arturo@endurance [tools]
11:26 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:8a9b97e from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (eeeea4c) - cookbook ran by arturo@endurance [tools]
11:24 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:8a9b97e from https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-framework-api (618ab29) - cookbook ran by arturo@endurance [tools]
10:25 <arturo> build and push mariadb-sssd/base docker image for Toolforge (T320178, T254636) [tools]
2023-02-16 §
15:58 <wm-bot2> Increased quotas by 4000 gigabytes - cookbook ran by fran@wmf3169 [tools]
15:30 <wm-bot2> deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/cert-manager (d71994e) - cookbook ran by arturo@nostromo [tools]
13:52 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/ingress-admission-controller (7191997) - cookbook ran by taavi@runko [tools]
13:44 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/ingress-admission:1fe8ec4 from https://gerrit.wikimedia.org/r/cloud/toolforge/ingress-admission-controller (1fe8ec4) - cookbook ran by taavi@runko [tools]
12:47 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/ingress-admission:e9b9920 from https://gerrit.wikimedia.org/r/cloud/toolforge/ingress-admission-controller (e9b9920) - cookbook ran by taavi@runko [tools]
10:35 <arturo> aborrero@tools-k8s-control-1:~$ sudo -i kubectl apply -f /etc/kubernetes/psp/base-pod-security-policies.yaml [tools]
09:48 <arturo> grid engine was failed over to shadow server, manually put it back into normal https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Grid#GridEngine_Master [tools]
09:39 <arturo> aborrero@tools-sgegrid-shadow:~$ sudo truncate -s 1G /var/log/syslog (was 17G, full root disk) [tools]
2023-02-15 §
18:03 <taavi> deployed https://gerrit.wikimedia.org/r/c/operations/puppet/+/889585/ to increase amount of haproxy max connections [tools]
15:19 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@nostromo [tools]
09:50 <wm-bot2> deployed kubernetes component https://gitlab.wikimedia.org/repos/cloud/toolforge/cert-manager.git (e3f3ce1) (T329453) - cookbook ran by taavi@runko [tools]
09:30 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@nostromo [tools]
2023-02-14 §
15:07 <taavi> import cert-manager components to local docker registry T329453 [tools]
12:12 <arturo> the fixed webservicemonitor is starting a bunch of grid webservices (T329611) [tools]
12:09 <arturo> included tools-manifests 0.25 in tools-buster aptly repo, deploying it now! (T329611, T329467, T244809) [tools]
2023-02-13 §
16:05 <wm-bot2> Increased quotas by 4000 gigabytes - cookbook ran by fran@wmf3169 [tools]
16:03 <taavi> update maintain-kubeusers deployment to use helm [tools]
15:05 <taavi> deploy jobs-api updates, improving some status messages [tools]
15:04 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (13d87c4) - cookbook ran by taavi@runko [tools]
15:00 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:390ed64 from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (390ed64) - cookbook ran by taavi@runko [tools]
13:14 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/maintain-kubeusers:aac195b from https://gerrit.wikimedia.org/r/labs/tools/maintain-kubeusers (aac195b) - cookbook ran by taavi@runko [tools]
2023-02-10 §
15:45 <taavi> reboot tools-k8s-worker-82 to troubleshoot network issues [tools]
12:44 <wm-bot2> Added a new k8s worker tools-k8s-worker-82.tools.eqiad1.wikimedia.cloud to the worker pool (T329357) - cookbook ran by taavi@runko [tools]
12:31 <wm-bot2> Adding a new k8s worker node (T329357) - cookbook ran by taavi@runko [tools]
12:29 <wm-bot2> Added a new k8s worker tools-k8s-worker-81.tools.eqiad1.wikimedia.cloud to the worker pool (T329357) - cookbook ran by taavi@runko [tools]
12:15 <wm-bot2> Adding a new k8s worker node (T329357) - cookbook ran by taavi@runko [tools]
11:53 <wm-bot2> Adding a new k8s worker node (T329357) - cookbook ran by taavi@runko [tools]
11:44 <wm-bot2> removing grid node tools-sgeweblight-10-23.tools.eqiad1.wikimedia.cloud (T329357) - cookbook ran by taavi@runko [tools]