Parquet V2 pages can control compression at page granularity. The parquet writer currently leverages this by disregarding the compression if the compressed size is equal or larger. A user might want to configure their own threshold for this, say preferring uncompressed if compression achieves less that 10% space savings.
Addressed by #9826
Parquet V2 pages can control compression at page granularity. The parquet writer currently leverages this by disregarding the compression if the compressed size is equal or larger. A user might want to configure their own threshold for this, say preferring uncompressed if compression achieves less that 10% space savings.
Addressed by #9826