1-50 of 3603 results (27ms)
2022-12-12 §
14:36 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by dcaro@vulcanus [tools]
2022-12-09 §
07:20 <taavi> change the canonical tools-mail external hostname to use mail.tools.wmcloud.org and add valid spf to toolforge.org T324809 [tools]
2022-12-05 §
11:06 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by dcaro@vulcanus [tools]
2022-11-30 §
10:39 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (bc3529d) - cookbook ran by arturo@nostromo [tools]
10:17 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:c360d54 from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (c360d54) - cookbook ran by arturo@nostromo [tools]
2022-11-29 §
19:52 <taavi> clear puppet failure emails from exim queues [tools]
2022-11-09 §
08:58 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by arturo@nostromo [tools]
2022-11-05 §
19:28 <andrewbogott> cleaning up nfs share with root@labstore1004:/srv/tools/shared/tools# find -name '*.err' -size +1G -exec truncate --size=1G {} \; [tools]
13:26 <andrewbogott> cleaning up nfs share with root@labstore1004:/srv/tools/shared/tools# find -name '*.log' -size +1G -exec truncate --size=1G {} \; [tools]
2022-11-04 §
20:41 <andrewbogott> cleaning up nfs share with root@labstore1004:/srv/tools/shared/tools# find -name '*.err' -not -newermt "Nov 1, 2021" -exec rm {} \; [tools]
14:02 <andrewbogott> cleaning up nfs share with root@labstore1004:/srv/tools/shared/tools# find -name '*.log' -not -newermt "Nov 1, 2021" -exec rm {} \; [tools]
12:20 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (d464be4) (T304900) - cookbook ran by arturo@nostromo [tools]
12:12 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:2b800f5 from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (2b800f5) (T304900) - cookbook ran by arturo@nostromo [tools]
2022-11-01 §
09:37 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master (T322110) - cookbook ran by dcaro@vulcanus [tools]
2022-10-26 §
08:45 <dcaro> depooling and rebooting tools-sgeexec-10-22 to get nfs scratch working again [tools]
2022-10-25 §
16:14 <wm-bot2> Increased quotas by 5120 gigabytes - cookbook ran by fran@wmf3169 [tools]
15:26 <dcaro> pushed a newer docker-registry.tools.wmflabs.org/python:3.9-slim-bullseye (from upstream pthyon:3.9-slim-bullseye) [tools]
2022-10-20 §
16:54 <andrewbogott> rebooting tools-package-builder-04 [tools]
16:49 <andrewbogott> rebooting redis nodes (one at a time) [tools]
10:54 <taavi> rebuild mono68-sssd image with the expired DST Root CA X3 removed T311466 [tools]
2022-10-18 §
11:52 <taavi> deploy toolforge-jobs-framework-cli deb v8 [tools]
10:30 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-emailer (64385e9) (T320405) - cookbook ran by arturo@nostromo [tools]
10:27 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:9be2272 from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (9be2272) - cookbook ran by taavi@runko [tools]
10:18 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-emailer:latest from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-emailer (64385e9) (T320405) - cookbook ran by arturo@nostromo [tools]
2022-10-17 §
07:25 <taavi> push updated perl532 images T320824 [tools]
2022-10-14 §
07:54 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (0cc020e) (T311466) - cookbook ran by taavi@runko [tools]
2022-10-13 §
15:10 <arturo> restart jobs-emailer pod [tools]
2022-10-12 §
23:25 <bd808> Rebuilding all Toolforge docker images (T278436, T311466, T293552) [tools]
20:43 <bd808> Rebuilding all Toolforge docker images to pick up bug and security fix packages. Third try seems to be working. (T316554) [tools]
20:31 <bd808> Rebuilding all Toolforge docker images to pick up bug and security fix packages after fixing bug in building the bullseye base image. (T316554) [tools]
16:26 <dcaro> deploy the latest registry admission webhook, now for real (image tag 07bc7db) [tools]
12:48 <dcaro> deploy the latest registry admission webhook (image tag 07bc7db) [tools]
09:26 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by dcaro@vulcanus [tools]
09:18 <wm-bot2> cleaned up grid queue errors on tools-sgegrid-master - cookbook ran by dcaro@vulcanus [tools]
2022-10-11 §
13:52 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:8574c36 from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (8574c36) - cookbook ran by taavi@runko [tools]
2022-10-10 §
19:30 <taavi> rebooting all k8s worker nodes to clean up labstore1006/7 remains [tools]
16:51 <taavi> clean up labstore1006/7 mounts from k8s control nodes T320425 [tools]
11:35 <arturo> aborrero@tools-k8s-control-1:~$ sudo -i kubectl -n jobs-emailer rollout restart deployment/jobs-emailer (T317998) [tools]
08:44 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (afa90ed) (T320284) - cookbook ran by taavi@runko [tools]
08:39 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/toolforge-jobs-framework-api:latest from https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (afa90ed) - cookbook ran by taavi@runko [tools]
2022-10-09 §
17:29 <taavi> kill 10 idle tmux sessions of user 'hoi' on tools-sgebastion-10 T320352 [tools]
2022-10-07 §
13:02 <taavi> taavi@cloudcontrol1005 ~ $ sudo mark_tool --disable oncall # T320240 [tools]
2022-10-06 §
00:39 <bd808> Image rebuild failing with debian apt repo signature issue. Will investigate tomorrow. (T316554) [tools]
00:36 <bd808> Rebuilding all Toolforge docker images to pick up bug and security fix packages. (T316554) [tools]
00:04 <bd808> Building new php74-sssd-base & web images (T310435) [tools]
2022-10-03 §
14:36 <wm-bot2> build & push docker image docker-registry.tools.wmflabs.org/volume-admission:latest from https://gerrit.wikimedia.org/r/cloud/toolforge/volume-admission-controller (8da432b) - cookbook ran by taavi@runko [tools]
2022-09-28 §
21:23 <lucaswerkmeister> on tools-sgebastion-10: run-puppet-agent # T318858 [tools]
21:22 <lucaswerkmeister> on tools-sgebastion-10: apt remove emacs-common emacs-bin-common # fix package conflict, T318858 [tools]
21:15 <lucaswerkmeister> added root SSH key for myself, manually ran puppet on tools-sgebastion-10 to apply it (seemingly successfully) [tools]
2022-09-22 §
12:30 <taavi> add TheresNoTime to the 'toollabs-trusted' gerrit group T317438 [tools]