2401-2450 of 3115 results (27ms)
2022-08-12 §
07:24 <dcaro_away> started postgresql on puppetdb-02, might have crashed during the ceph issues, now puppet runs on toolsbeta work again [toolsbeta]
2022-08-03 §
15:46 <dhinus> recreated jobs-api pods to pick up new ConfigMap [toolsbeta]
14:51 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (c47ac41) - cookbook ran by fran@MacBook-Pro.station [toolsbeta]
2022-08-01 §
14:01 <taavi> unbreak acme-chief after keystone communication issues [toolsbeta]
2022-07-19 §
15:45 <taavi> deploying and testing maintain-kubeusers updates [toolsbeta]
2022-06-28 §
15:23 <wm-bot2> Adding a new k8s worker node - cookbook ran by taavi@runko [toolsbeta]
2022-06-24 §
07:01 <wm-bot2> removing grid node toolsbeta-sgewebgrid-lighttpd-0901.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by taavi@runko [toolsbeta]
06:59 <wm-bot2> removing grid node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by taavi@runko [toolsbeta]
06:57 <wm-bot2> removing grid node toolsbeta-sgeexec-0902.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by taavi@runko [toolsbeta]
06:55 <wm-bot2> removing grid node toolsbeta-sgeexec-0901.toolsbeta.eqiad1.wikimedia.cloud - cookbook ran by taavi@runko [toolsbeta]
2022-06-19 §
16:28 <taavi> restart OOM'd puppetdb on toolsbeta-puppetdb-02 [toolsbeta]
2022-06-03 §
13:17 <bd808> publish tools-webservice 0.86 (T309821) [toolsbeta]
05:25 <wm-bot2> rebooted buster weblight grid workers - cookbook ran by taavi@runko [toolsbeta]
05:20 <wm-bot2> rebooting buster weblight grid workers - cookbook ran by taavi@runko [toolsbeta]
05:20 <wm-bot2> rebooting stretch weblight grid workers - cookbook ran by taavi@runko [toolsbeta]
2022-05-30 §
13:42 <taavi> run grid-configurator to remove stale config for some removed nodes [toolsbeta]
2022-05-26 §
15:38 <wm-bot2> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (e6fa299) - cookbook ran by taavi@runko [toolsbeta]
2022-04-20 §
07:53 <wm-bot> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (8f37a04) (T305592) - cookbook ran by taavi@runko [toolsbeta]
2022-04-15 §
13:26 <taavi> shutdown toolsbeta-services-01, not exactly sure what it does and it has no roles applied T306100 [toolsbeta]
2022-04-11 §
14:47 <dcaro> deploying custom version of the regitsry admission hook [toolsbeta]
2022-04-08 §
10:45 <arturo> disabled debug mode on the k8s jobs-emailer component [toolsbeta]
2022-04-05 §
07:43 <wm-bot> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (d7d3463) - cookbook ran by arturo@nostromo [toolsbeta]
07:21 <arturo> deploying toolforge-jobs-framework-cli v7 [toolsbeta]
2022-04-04 §
16:58 <wm-bot> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-api (cbcfc47) - cookbook ran by arturo@nostromo [toolsbeta]
09:28 <arturo> deployed toolforge-jobs-framework-cli v6 into aptly and installed it on buster bastions [toolsbeta]
2022-03-25 §
11:31 <dcaro> All alerting VMs rebooted, checking that everything is "working" (T304672) [toolsbeta]
10:55 <dcaro> force restarting all the other nfs-bound VMs one by one (T304672) [toolsbeta]
10:43 <dcaro> restarting the sge-shadow (T304672) [toolsbeta]
10:32 <dcaro> restarting the sge-master (T304672) [toolsbeta]
2022-03-16 §
15:23 <taavi> deploying https://gerrit.wikimedia.org/r/c/cloud/toolforge/volume-admission-controller/+/737171/ as a T292238 test to toolsbeta [toolsbeta]
2022-03-15 §
17:55 <wm-bot> deployed kubernetes component https://gerrit.wikimedia.org/r/cloud/toolforge/jobs-framework-emailer (084ee51) - cookbook ran by arturo@nostromo [toolsbeta]
2022-03-14 §
16:14 <wm-bot> Updating the distroless/base image on docker-registry.tools.wmflabs.org - cookbook ran by dcaro@vulcanus [toolsbeta]
2022-03-11 §
15:55 <dcaro> added provisional toolforg cli package to toolsbeta buster repo (T299026) [toolsbeta]
15:11 <dcaro> added tekton cli package to toolsbeta repos (T299026) [toolsbeta]
15:02 <arturo> deploy jobs-framework-emailer 9470a5f (T286135) [toolsbeta]
11:59 <arturo> deploy jobs-framework-emailer d60ffd6 (T286135) [toolsbeta]
2022-03-08 §
08:20 <taavi> reboot toolsbeta-cumin-1 for kernel updates [toolsbeta]
2022-03-07 §
15:44 <dcaro> Deployed buildpack-admission-controller with the latest code (T297090) [toolsbeta]
2022-02-17 §
08:16 <taavi> made toolsbeta-puppetmaster-04 its own client to fix `puppet node deactivate` puppetdb access [toolsbeta]
2022-02-08 §
13:04 <arturo> livehacking puppetmaster with https://gerrit.wikimedia.org/r/c/operations/puppet/+/760933 (T284767) [toolsbeta]
12:19 <arturo> created puppet prefix `toolsbeta-sgecron` with proper hiera/roles [toolsbeta]
12:16 <arturo> created VM toolsbeta-sgecron-02 (T284767) [toolsbeta]
2022-02-04 §
18:53 <taavi> upgrading to kubernetes 1.21 T282942 [toolsbeta]
2022-01-28 §
16:28 <wm-bot> trying to join node toolsbeta-sgewebgen-09-1.toolsbeta.eqiad1.wikimedia.cloud to the grid cluster in toolsbeta. - cookbook ran by arturo@nostromo [toolsbeta]
2022-01-25 §
11:45 <wm-bot> reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo [toolsbeta]
2022-01-20 §
12:35 <wm-bot> removing grid node toolsbeta-sgeexec-1003 (depool/drain, remove VM and reconfigure grid) - cookbook ran by arturo@nostromo [toolsbeta]
12:34 <wm-bot> removing grid node toolsbeta-sgeexec-1004 (depool/drain, remove VM and reconfigure grid) - cookbook ran by arturo@nostromo [toolsbeta]
2022-01-19 §
14:11 <arturo> craeted 'automated-toolforge-tests' tool account following https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Toolsbeta#create_a_tool_account_in_toolsbeta [toolsbeta]
2022-01-18 §
15:56 <wm-bot> removing grid node toolsbeta-sgewebgrid-generic-0901 (depool/drain, remove VM and reconfigure grid) - cookbook ran by andrew@buster [toolsbeta]
15:30 <andrewbogott> switching scratch mount over to the cloud-hosted service with git fetch https://gerrit.wikimedia.org/r/operations/puppet refs/changes/43/754043/1 && git cherry-pick FETCH_HEAD [toolsbeta]