Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qwen2.5-Coder calling is a bit different? #12

Open
aep opened this issue Feb 23, 2025 · 0 comments
Open

Qwen2.5-Coder calling is a bit different? #12

aep opened this issue Feb 23, 2025 · 0 comments

Comments

@aep
Copy link

aep commented Feb 23, 2025

i'm not sure whats up with this but qwens tool calling doesnt apear to actually emit tool tokens?
yet it somehow works with cline so i wonder if its worth figuring this out.

./mcphost --openai-url http://192.168.92.1:8000 --model "openai:Qwen/Qwen2.5-Coder-32B-Instruct-AWQ" --openai-api-key bob
2025/02/23 10:55:12 INFO Model loaded provider=openai model=Qwen/Qwen2.5-Coder-32B-Instruct-AWQ
2025/02/23 10:55:12 INFO Initializing server... name=filesystem
2025/02/23 10:55:12 INFO Server connected name=filesystem
2025/02/23 10:55:12 INFO Tools loaded server=filesystem count=11

  You: please list files

  Assistant:                                                                                                                                                                 


  {"name": "filesystem__list_directory", "arguments": {"path": "."}}   
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant