BigHugger
sk Skill · Unknown-333

optimizing-parquet-storage

Optimize columnar Parquet storage for analytics — file and row-group sizing, compression codecs (Snappy/ZSTD), partitioning and file layout, column pruning and predicate pushdown, dictionary encoding, and fixing the small-files problem. Use when Parquet reads are slow or costly, files are too small/large, choosing compression or partitioning, or improving scan pruning on a data lake.

installs 8w
0
30-day movement
starts with the next reading
Related entries
1
Connections
0
pythonPython
Host repository
Unknown-333/awesome-data-engineering-skills
Host stars
18
Host language
Python