151-200 of 3536 results (22ms)
2022-02-10 §
13:24 <wm-bot> trying to join node tools-sgewebgen-10-1 to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
13:07 <wm-bot> trying to join node tools-sgeweblight-10-5 to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
13:06 <wm-bot> trying to join node tools-sgeweblight-10-4 to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
13:05 <wm-bot> trying to join node tools-sgeweblight-10-3 to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
13:03 <wm-bot> trying to join node tools-sgeweblight-10-2 to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
12:54 <wm-bot> trying to join node tools-sgeweblight-10-1.tools.eqiad1.wikimedia.cloud to the grid cluster in tools. - cookbook ran by arturo@nostromo [tools]
08:45 <taavi> set `profile::base::manage_ssh_keys: true` globally T214427 [tools]
08:16 <taavi> enable puppetdb and re-enable puppet with puppetdb ssh key management disabled (profile::base::manage_ssh_keys: false) - T214427 [tools]
08:06 <taavi> disable puppet globally for enabling puppetdb T214427 [tools]
2022-02-09 §
19:29 <taavi> installed tools-puppetdb-1, not configured on puppetmaster side yet T214427 [tools]
18:56 <wm-bot> pooled 10 grid nodes tools-sgeweblight-10-[1-5],tools-sgewebgen-10-[1,2],tools-sgeexec-10-[1-10] (T277653) - cookbook ran by arturo@nostromo [tools]
18:30 <wm-bot> pooled 9 grid nodes tools-sgeexec-10-[2-10],tools-sgewebgen-[3,15] - cookbook ran by arturo@nostromo [tools]
18:25 <arturo> ignore last message [tools]
18:24 <wm-bot> pooled 9 grid nodes tools-sgeexec-10-[2-10],tools-sgewebgen-[3,15] - cookbook ran by arturo@nostromo [tools]
14:04 <taavi> created tools-cumin-1/toolsbeta-cumin-1 T298191 [tools]
2022-02-07 §
17:37 <taavi> generated authdns_acmechief ssh key and stored password in a text file in local labs/private repository (T288406) [tools]
12:52 <taavi> updated maintain-kubeusers for T301081 [tools]
2022-02-04 §
22:33 <taavi> `root@tools-sgebastion-10:/data/project/ru_monuments/.kube# mv config old_config` # experimenting with T301015 [tools]
21:36 <taavi> clear error state from some webgrid nodes [tools]
2022-02-03 §
09:06 <taavi> run `sudo apt-get clean` on login-buster/dev-buster to clean up disk space [tools]
08:01 <taavi> restart acme-chief to force renewal of toolserver.org certificate [tools]
2022-01-30 §
14:41 <taavi> created a neutron port with ip 172.16.2.46 for a service ip for toolforge redis automatic failover T278541 [tools]
14:22 <taavi> creating a cluster of 3 bullseye redis hosts for T278541 [tools]
2022-01-26 §
18:33 <wm-bot> depooled grid node tools-sgeexec-10-10 - cookbook ran by arturo@nostromo [tools]
18:33 <wm-bot> depooled grid node tools-sgeexec-10-9 - cookbook ran by arturo@nostromo [tools]
18:33 <wm-bot> depooled grid node tools-sgeexec-10-8 - cookbook ran by arturo@nostromo [tools]
18:32 <wm-bot> depooled grid node tools-sgeexec-10-7 - cookbook ran by arturo@nostromo [tools]
18:32 <wm-bot> depooled grid node tools-sgeexec-10-6 - cookbook ran by arturo@nostromo [tools]
18:31 <wm-bot> depooled grid node tools-sgeexec-10-5 - cookbook ran by arturo@nostromo [tools]
18:30 <wm-bot> depooled grid node tools-sgeexec-10-4 - cookbook ran by arturo@nostromo [tools]
18:28 <wm-bot> depooled grid node tools-sgeexec-10-3 - cookbook ran by arturo@nostromo [tools]
18:27 <wm-bot> depooled grid node tools-sgeexec-10-2 - cookbook ran by arturo@nostromo [tools]
18:27 <wm-bot> depooled grid node tools-sgeexec-10-1 - cookbook ran by arturo@nostromo [tools]
13:55 <arturo> scaling up the buster web grid with 5 lighttd and 2 generic nodes (T277653) [tools]
2022-01-25 §
11:50 <wm-bot> reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo [tools]
11:44 <arturo> rebooting buster exec nodes [tools]
08:34 <taavi> sign puppet certificate for tools-sgeexec-10-4 [tools]
2022-01-24 §
17:44 <wm-bot> reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo [tools]
15:22 <arturo> scaling up the grid with 10 buster exec nodes (T277653) [tools]
2022-01-20 §
17:05 <arturo> drop 9 of the 10 buster exec nodes created earlier. They didn't get DNS records [tools]
12:56 <arturo> scaling up the grid with 10 buster exec nodes (T277653) [tools]
2022-01-19 §
17:34 <andrewbogott> rebooting tools-sgeexec-0913.tools.eqiad1.wikimedia.cloud to recover from (presumed) fallout from the scratch/nfs move [tools]
2022-01-14 §
19:09 <taavi> set /var/run/lighttpd as world-writable on all lighttpd webgrid nodes, T299243 [tools]
2022-01-12 §
11:27 <arturo> created puppet prefix `tools-sgeweblight`, drop `tools-sgeweblig` [tools]
11:03 <arturo> created puppet prefix 'tools-sgeweblig' [tools]
11:02 <arturo> created puppet prefix 'toolsbeta-sgeweblig' [tools]
2022-01-04 §
17:18 <bd808> tools-acme-chief-01: sudo service acme-chief restart [tools]
08:12 <taavi> disable puppet & exim4 on T298501 [tools]
2021-12-31 §
19:48 <taavi> reset grid error status on webgrid-lighttpd@tools-sgewebgrid-lighttpd-0915 [tools]
2021-12-28 §
20:31 <taavi> restarting acme-chief to debug T298353 [tools]