I can use a local model (for example meta-llama-3-8b-instruct) for the action “Transform & Replace Selection With ChatGPT (Or compatible AI API)”? And, if possible, how do I configure the API Key section? Thank you.
Action local model for the action “Transform & Replace Selection With ChatGPT (Or compatible AI API)
you can enter anything there if you are using a local model, it just can not be empty
I don't know what I'm doing wrong. I'm leaving you a screenshot. I've installed Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf, but regardless of whether I put this name or its abbreviation (the one that appears in the capture or another like "mi-llama3"), the action doesn't work correctly: it should fix the text, but instead it deletes it. Thank you for any help you can offer me
You haven't entered the URL that shall be called "Optional: Custom Completion URL (For Using Compatible AI APIS)*
What app are you using to run the model?
It's something like, this but the port needs to be adapted
http://127.0.0.1:1234/v1/chat/completions
I'm using LM Studio. I'm providing you with Capture-1, which includes the usage API data.
With these data (which are shown in Capture-2), the application BTT unexpectedly closes.
Thank you.
in that case the URL you can use is http://127.0.0.1:1234/v1/chat/completions
1 Like
Thank you for your prompt and kind response. Now it works perfectly fine. Very grateful.