LM Studio Support

[badboyilprimo]

Can this work with LM Studio which allows different models to be used more than Ollama?

[LoggeL]

If that has an OpenAI compatible API you can use the OpenAI model provider.

[LoggeL]

Use #60 for that

[badboyilprimo]

Thank you for the response, the following works

change models to this in config.py
openai://lmstudio-ai/gemma-2b-it-GGUF

and this
python ./Write.py -Prompt "~\AIStoryWriter\ExamplePrompts\Example1.txt" -InitialOutlineModel "openai://lmstudio-ai/gemma-2b-it-GGUF@http://localhost:1234/v1/" -ChapterOutlineModel "openai://lmstudio-ai/gemma-2b-it-GGUF@http://localhost:1234/v1/"

the thing that I don't understand, is how to make it generate lets say 5 stories and the stop, it seems to be generating stories now non-stop

[badboyilprimo]

after getting API key error multiple time, I had to change the base URL for openai to LM Studio URL

[LoggeL]

Ah ye sorry. Will adjust the documentation when I get the chance to merge the PR