Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for alternate OpenAI URL in settings #7565

Closed
1 task done
tjohnman opened this issue Feb 8, 2024 · 5 comments
Closed
1 task done

Support for alternate OpenAI URL in settings #7565

tjohnman opened this issue Feb 8, 2024 · 5 comments
Labels
ai Improvement related to Assistant, Copilot, or other AI features feature [core label] setting Feedback for preferences, configuration, etc

Comments

@tjohnman
Copy link

tjohnman commented Feb 8, 2024

Check for existing issues

  • Completed

Describe the feature

Some services, like Perplexity AI, offer an OpenAI-compatible drop-in replacement API. By providing a way to change the URL Zed uses to send requests to OpenAI, it would get support for these services "for free".

If applicable, add mockups / screenshots to help present your vision of the feature

Something like:

{
  "assistant":  {
    "default_open_ai_url": "https://api.perplexity.ai/"
    ...
  }
}
@tjohnman tjohnman added admin read feature [core label] labels Feb 8, 2024
@JosephTLyons JosephTLyons added setting Feedback for preferences, configuration, etc ai Improvement related to Assistant, Copilot, or other AI features and removed triage labels Feb 9, 2024
@willtejeda
Copy link

I was looking for this setting, it's surprising that it's not implemented already.

Ollama now has openai compatible API ( for chat completion) so it's a great time to get this added

@afinno
Copy link

afinno commented Feb 13, 2024

This would be a great enhancement. I'd also like to point out that LM Studio also offers an OpenAI compatible API locally.

It could work similarly to the Continue plugin for VSCode.

Sample of Continue config.json:

{
  "models": [
    {
      "title": "GPT-4",
      "provider": "openai",
      "model": "gpt-4"
    },
    {
      "title": "Mixtral",
      "provider": "lmstudio",
      "apiBase": "http://localhost:1234/v1",
      "completionOptions": {},
      "model": "mixtral-8x7b"
    }
  ]
}

@afinno
Copy link

afinno commented Feb 13, 2024

Also a related thread/issue.

#6708

@localSummer
Copy link

The openai_api_url setting has been added in the latest preview version

@SomeoneToIgnore
Copy link
Contributor

Closed in #7484

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ai Improvement related to Assistant, Copilot, or other AI features feature [core label] setting Feedback for preferences, configuration, etc
Projects
None yet
Development

No branches or pull requests

6 participants