You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently, there isn't a method in predicate_pushdown.cpp (filter_row_groups) to check if row group stats aren't available. Hence, we can't ever set num_surviving_row_groups.after_stats_filter to std::nullopt if stats are unavailable.
Describe the solution you'd like
We should figure out a relatively cheaper way to distinguish if row group stats aren't available if possible.
Describe alternatives you've considered
We currently build the entire statsAST table in predicate_pushdown and try to filter row groups with it. In case no row groups are filtered, we can't distinguish if this was due to ineffective filter or missing stats.
The text was updated successfully, but these errors were encountered:
mhaseeb123
changed the title
Add a method to check if row group stats are available
[FEA] Add a method to check if row group stats are available
Jan 29, 2025
Is your feature request related to a problem? Please describe.
Currently, there isn't a method in predicate_pushdown.cpp (filter_row_groups) to check if row group stats aren't available. Hence, we can't ever set
num_surviving_row_groups.after_stats_filter
tostd::nullopt
if stats are unavailable.Describe the solution you'd like
We should figure out a relatively cheaper way to distinguish if row group stats aren't available if possible.
Describe alternatives you've considered
We currently build the entire
statsAST
table in predicate_pushdown and try to filter row groups with it. In case no row groups are filtered, we can't distinguish if this was due to ineffective filter or missing stats.Additional context
Originally posted by @mhaseeb123 in #17594 (comment)
The text was updated successfully, but these errors were encountered: