Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SQL agent strategy #1039

Merged
merged 48 commits into from
Dec 18, 2024
Merged

Conversation

minmin-intel
Copy link
Collaborator

Description

  1. Add sql_agent_llama for open-source models and sql_agent for OpenAI models.
  2. Build vllm-gaudi docker image from vllm mainstream repo.
  3. Fix CI vllm guided decoding issue by adding command line args.

Issues

#976

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

UT, local test with OpenAI models

minmin-intel and others added 30 commits December 3, 2024 15:17
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Signed-off-by: minmin-intel <[email protected]>
Copy link
Collaborator

@lkk12014402 lkk12014402 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lvliang-intel lvliang-intel merged commit 717c3c1 into opea-project:main Dec 18, 2024
14 checks passed
smguggen pushed a commit to opea-aws-proserve/GenAIComps that referenced this pull request Jan 23, 2025
* initial code for sql agent llama

Signed-off-by: minmin-intel <[email protected]>

* add test for sql agent

Signed-off-by: minmin-intel <[email protected]>

* update sql agent test

Signed-off-by: minmin-intel <[email protected]>

* fix bugs and use vllm to test sql agent

Signed-off-by: minmin-intel <[email protected]>

* add tag-bench test and google search tool

Signed-off-by: minmin-intel <[email protected]>

* test sql agent with hints

Signed-off-by: minmin-intel <[email protected]>

* fix bugs for sql agent with hints and update test

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add readme for sql agent and fix ci bugs

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add sql agent using openai models

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bugs in sql agent openai

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make wait time longer for sql agent microservice to be ready

Signed-off-by: minmin-intel <[email protected]>

* update readme

Signed-off-by: minmin-intel <[email protected]>

* fix test bug

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* skip planexec with vllm due to vllm-gaudi bug

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* debug ut issue

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* use vllm for all uts

Signed-off-by: minmin-intel <[email protected]>

* debug ci issue

Signed-off-by: minmin-intel <[email protected]>

* change vllm port

Signed-off-by: minmin-intel <[email protected]>

* update ut

Signed-off-by: minmin-intel <[email protected]>

* remove tgi server

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* align vllm port

Signed-off-by: minmin-intel <[email protected]>

* remove unnecessary files and fix bugs

Signed-off-by: minmin-intel <[email protected]>

* connect to db with full uri

Signed-off-by: minmin-intel <[email protected]>

* update readme and use vllm mainstream

Signed-off-by: minmin-intel <[email protected]>

* rm unnecessary log

Signed-off-by: minmin-intel <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme

Signed-off-by: minmin-intel <[email protected]>

* update test script

Signed-off-by: minmin-intel <[email protected]>

---------

Signed-off-by: minmin-intel <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants