Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: Diversifying prompts/benchmark ReAct few-shot example lengths #194

Closed
alckasoc opened this issue Jul 2, 2024 · 0 comments · Fixed by #196
Closed

[Feature Request]: Diversifying prompts/benchmark ReAct few-shot example lengths #194

alckasoc opened this issue Jul 2, 2024 · 0 comments · Fixed by #196
Assignees
@GaoDalie @alckasoc @tedasdf
Labels
enhancement New feature or request
Milestone
Organized, Self-C...

Comments

@alckasoc
Copy link
Member

alckasoc commented Jul 2, 2024

Feature Description

A ReAct trajectory is:
Thought 1: ...
Action 1: ...
Observation 1: ...

The few-shot examples in prompts/benchmark that are of the ReAct style are somewhat uniform in trajectory length (the above trajectory is of length 1; each unit consists of a thought-action-observation triplet). Can we diversify the lengths a bit?

Reason

No response
@alckasoc alckasoc added the enhancement New feature or request label Jul 2, 2024
@GaoDalie GaoDalie self-assigned this Jul 2, 2024
@alckasoc alckasoc linked a pull request Jul 3, 2024 that will close this issue
Let's get this done #196
Merged
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@GaoDalie GaoDalie

@alckasoc alckasoc

@tedasdf tedasdf

Labels
enhancement New feature or request
Projects
None yet
Milestone
Organized, Self-Contained Modules & S...
Development

Successfully merging a pull request may close this issue.

Let's get this done agential-ai/agential
3 participants
@GaoDalie @alckasoc @tedasdf