You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I use the OpenAI Chat Completions API provided by Ollama, the content returned by LLM is empty. And when the stop parameter is set to None, LLM can respond normally.
The text was updated successfully, but these errors were encountered:
Hey, appreciate the feedback. We didn't test the framework with Ollama. Infrastructure for using models is ultimately up to the user - we simply provided the model wrappers we used in our experiments as an example.
If you'd like - you can make a pull request to include generalized Ollama support! Thanks.
When I use the OpenAI Chat Completions API provided by Ollama, the content returned by LLM is empty. And when the stop parameter is set to None, LLM can respond normally.
The text was updated successfully, but these errors were encountered: