Press "Enter" to skip to content

Converting CSV Files to Parquet Format

Michael Mayer does a bit of file conversion:

Conversion from CSV to Parquet in streaming mode? No problem for the two power houses Polars and DuckDB. We can even throw in some data preprocessing steps in-between, like column selection, data filters, or sorts.

This is certainly not the only way to perform the task, though it’s fast and effective.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.