Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Multi-node aggregation by integrating it with the Peer Forwarder #978

Closed
dlvenable opened this issue Feb 4, 2022 · 2 comments
Closed

Support Multi-node aggregation by integrating it with the Peer Forwarder #978

dlvenable opened this issue Feb 4, 2022 · 2 comments
Assignees
@asifsmohammed
Labels
enhancement New feature or request
Milestone
v2.0

Comments

@dlvenable
Copy link
Member

dlvenable commented Feb 4, 2022 •
edited
Loading

The aggregate processor as implemented for Data Prepper 1.3.0 will only support single-node deployments. Integrating it into the core Peer Forwarder (#700) will allow it to work with multiple nodes.
@dlvenable dlvenable mentioned this issue Feb 4, 2022
Closed
6 tasks
@dlvenable dlvenable added this to the v1.4 milestone Feb 4, 2022
@dlvenable dlvenable changed the title Integrate AggregateProcessor with the Peer Forwarder Support Multi-node aggregation by integrating it with the Peer Forwarder Feb 18, 2022
@dlvenable dlvenable removed this from the v1.4 milestone Mar 21, 2022
@dlvenable dlvenable added this to the v2.0 milestone Apr 19, 2022
@dlvenable dlvenable added enhancement New feature or request and removed untriaged labels Apr 19, 2022
@dlvenable
Copy link
Member Author

dlvenable commented Apr 19, 2022 •
edited
Loading

This feature depends on #1189 since the AggregateProcessor is very intentionally not @SingleThread.

I don't believe this is accurate for this task.

@asifsmohammed
Copy link
Collaborator

Integrated aggregate processor with core peer forwarder as part of this PR. #1767

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@asifsmohammed asifsmohammed

Labels
enhancement New feature or request
Projects
Data Prepper Tracking Board
Archived in project
Milestone
v2.0
Development

No branches or pull requests
2 participants
@dlvenable @asifsmohammed