Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement]: Support data expiration based on partition information #3272

Closed
3 tasks done
lintingbin opened this issue Oct 17, 2024 · 0 comments · Fixed by #3273
Closed
3 tasks done

[Improvement]: Support data expiration based on partition information #3272

lintingbin opened this issue Oct 17, 2024 · 0 comments · Fixed by #3273

Comments

@lintingbin
Copy link
Contributor

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

The current data-expire feature cannot function properly when the iceberg table does not have metrics enabled or when the metrics are ineffective (i.e., the datafile does not record the upper_bound of the expiration field). Hoping to implement the data-expire feature in cases where metrics information is missing.

How should we improve?

When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile.

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

@zhoujinsong zhoujinsong changed the title [Improvement]: When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile. [Improvement]: Support data expiration based on partition information Feb 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant