Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
2c6571a
Document nested pushdown semantics and optimizations
kosiew Dec 29, 2025
5ca433b
Refactor list predicate support and enhance tests
kosiew Dec 29, 2025
0b4c409
refactor(parquet): parameterize array function pushdown tests
kosiew Dec 29, 2025
02c35bc
docs(parquet): add comprehensive examples to pushdown API
kosiew Dec 29, 2025
81f4051
refactor: use for loop instead of while-let in array pushdown tests
kosiew Dec 29, 2025
ab3395b
docs(parquet): add clarifying comments for pushdown implementation
kosiew Dec 29, 2025
dc27504
refactor: remove dead code expectation from ProjectionColumns struct
kosiew Dec 29, 2025
40405cb
refactor: remove root_indices from ProjectionColumns struct
kosiew Dec 29, 2025
ce9da3b
refactor: implement trait-based approach for list column pushdown sup…
kosiew Dec 29, 2025
eaff899
Refactor expression handling and simplify predicates
kosiew Dec 29, 2025
6325c97
Add tests for array_has...
kosiew Dec 29, 2025
459988e
test: add physical plan tests for array functions and pushdown support
kosiew Dec 29, 2025
f894bd4
Refactor array function tests for clarity and conciseness
kosiew Dec 29, 2025
b815629
remove tests in supported_predicates.rs
kosiew Dec 29, 2025
0a769bd
add array functions example with logical and physical plan demonstrat…
kosiew Dec 29, 2025
94adbba
Revert "add array functions example with logical and physical plan de…
kosiew Dec 29, 2025
2007e47
test: add array function predicate pushdown tests for Parquet files
kosiew Dec 29, 2025
e0f9cd3
refactor: rename NestedBehavior to NestedColumnSupport for clarity
kosiew Dec 29, 2025
df94e30
Refactor nested type handling and simplify checks
kosiew Dec 29, 2025
13d685b
refactor: rename ProjectionColumns to LeafProjection for clarity
kosiew Dec 29, 2025
904c0d9
refactor: remove redundant array function predicate pushdown tests
kosiew Dec 29, 2025
a5bab42
test: add array function predicate pushdown slt tests for DataSourceExec
kosiew Dec 29, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions datafusion/datasource-parquet/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,8 @@ tokio = { workspace = true }

[dev-dependencies]
chrono = { workspace = true }
datafusion-functions-nested = { workspace = true }
tempfile = { workspace = true }

# Note: add additional linter rules in lib.rs.
# Rust does not support workspace + new linter rules in subcrates yet
Expand Down
1 change: 1 addition & 0 deletions datafusion/datasource-parquet/src/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ mod row_filter;
mod row_group_filter;
mod sort;
pub mod source;
mod supported_predicates;
mod writer;

pub use access_plan::{ParquetAccessPlan, RowGroupAccess};
Expand Down
Loading