Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add sst and tts capabilities to agent #2007

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Conversation

YujohnNattrass
Copy link
Collaborator

@YujohnNattrass YujohnNattrass commented Feb 22, 2025

Agents now have a voice property with a composite voice type which allows the agent to have different providers for its voice capabilities.

Here is an example of what it would look like to initialize:

export const chefAgent = new Agent({
  name: 'Agent',
  instructions: `You are capable of speech to text and text to speech`
  model: openai('gpt-4o-mini'),
  voice: new CompositeVoice({
    speakProvider: new ElevenLabsVoice(),
    listenProvider: new OpenAIVoice(),
  }),
});

Copy link

changeset-bot bot commented Feb 22, 2025

🦋 Changeset detected

Latest commit: 92637d4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 44 packages
Name Type
@mastra/core Minor
mastra Patch
@mastra/deployer Patch
@mastra/evals Patch
@mastra/loggers Patch
@mastra/mcp Patch
@mastra/memory Patch
@mastra/rag Patch
@mastra/deployer-cloudflare Patch
@mastra/deployer-netlify Patch
@mastra/deployer-vercel Patch
@mastra/store-pg Patch
@mastra/store-upstash Patch
@mastra/vector-astra Patch
@mastra/vector-chroma Patch
@mastra/vector-pg Patch
@mastra/vector-pinecone Patch
@mastra/vector-qdrant Patch
@mastra/vector-upstash Patch
@mastra/vector-vectorize Patch
@mastra/astra Patch
@mastra/chroma Patch
@mastra/pg Patch
@mastra/pinecone Patch
@mastra/qdrant Patch
@mastra/upstash Patch
@mastra/vectorize Patch
@mastra/speech-azure Patch
@mastra/speech-deepgram Patch
@mastra/speech-elevenlabs Patch
@mastra/speech-google Patch
@mastra/speech-ibm Patch
@mastra/speech-murf Patch
@mastra/speech-openai Patch
@mastra/speech-playai Patch
@mastra/speech-replicate Patch
@mastra/speech-speechify Patch
@mastra/client-js Patch
@mastra/composio Patch
@mastra/firecrawl Patch
@mastra/github Patch
@mastra/ragie Patch
@mastra/stabilityai Patch
memory-todo-agent Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link

vercel bot commented Feb 22, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
assistant-ui ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
bird-checker ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
crypto-chatbot ❌ Failed (Inspect) Feb 22, 2025 5:36am
mastra ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
openapi-spec-writer ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
travel-ai ❌ Failed (Inspect) Feb 22, 2025 5:36am
1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
mastra-docs ⬜️ Skipped (Inspect) Feb 22, 2025 5:36am

Copy link

promptless bot commented Feb 22, 2025

📝 Documentation updates detected! You can review documentation updates here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant