Support generating splits with finer granularity than file level#6917

Open

Shekharrajak wants to merge 9 commits intoapache:masterfrom

Shekharrajak:feature/finer-granularity-splits

Commits on Dec 28, 2025

Add FormatMetadataReader interface and FileSplitBoundary class
Shekharrajak
committed
Implement Parquet and ORC metadata readers for finer-grained splitting
Shekharrajak
committed
Add offset/length support to Parquet and ORC readers
Shekharrajak
committed
Add configuration options for fine-grained file splitting
Shekharrajak
committed
Add FineGrainedSplitGenerator decorator for row group/stripe splitting
Shekharrajak
committed
Add file split boundaries support to DataSplit
Shekharrajak
committed
Integrate fine-grained splitting with SnapshotReader
Shekharrajak
committed
Support fine-grained file splitting by row groups/stripes
Shekharrajak
committed

Commits on Dec 30, 2025

Fix paimon-docs test robustness and PartitionFileLister compilation error
Shekharrajak
committed