Press "Enter" to skip to content

Converting CSV Files to Parquet Format

Michael Mayer does a bit of file conversion:

Conversion from CSV to Parquet in streaming mode? No problem for the two power houses Polars and DuckDB. We can even throw in some data preprocessing steps in-between, like column selection, data filters, or sorts.

This is certainly not the only way to perform the task, though it’s fast and effective.