Convert Parquet To CSV in Python with Pandas

Convert Parquet To CSV in Python with Pandas | Step by Step Tutorial

Рет қаралды 11,704

Күн бұрын

Step by step tutorial on how to convert a single parquet file to a csv file using python with the pandas library. This video covers how to convert the data with without compression and with compression.
Timeline:
00:00 introduction
0:20 Read Parquet file Into Python
1:31 Write Without Compression
3:08 Write with gzip Compression
#python
#pandas

Пікірлер: 22

@aishamuhammed241 2 жыл бұрын

thank you so much, this helped me fix an urgent issue at work. subscribed!

@DataEngUncomplicated 2 жыл бұрын

Thanks Aisha! I'm glad it was helpful!

@felipecabral7034 2 жыл бұрын

Thanks! Helped a lot

@DataEngUncomplicated 2 жыл бұрын

I'm glad it was helpful Felipe!

@multitaskprueba1 2 жыл бұрын

Fantastic video! However, how would you convert in the other way around a FOLDER of CSV files to parquet files?

@DataEngUncomplicated 2 жыл бұрын

Thanks! the read CSV method should be able to handle a folder of CSV files!

@jorgeirai27 Жыл бұрын

Hi! Sorry, i have a question. I`ve already read my parquet file with pandas and succesfully modified it. But i don`t know how to resafe my modified parquet as a new parquet file. Do you know how to do it? Thank you

@DataEngUncomplicated Жыл бұрын

Hi Faze, To resave your data as a new parquet file, using aws data wrangler use the s3.to_parquet method: aws-sdk-pandas.readthedocs.io/en/stable/stubs/awswrangler.s3.to_parquet.html

@oscarandresgarnica6354 Жыл бұрын

Great video. Although, I am getting this error: ImportError: Unable to find a usable engine; tried using: 'pyarrow', 'fastparquet'. A suitable version of pyarrow or fastparquet is required for parquet support. Trying to import the above resulted in these errors: - Missing optional dependency 'pyarrow'. pyarrow is required for parquet support. Use pip or conda to install pyarrow. - Missing optional dependency 'fastparquet'. fastparquet is required for parquet support. Use pip or conda to install fastparquet.

@DataEngUncomplicated Жыл бұрын

Hey, follow these steps to install pandas correctly: I have a seperate video to solve this issue kzfaq.info/get/bejne/jqx_aM2VrNmxlZ8.html

@Yush214 Жыл бұрын

Hey can you make a video on how to convert a CSV file to an orc file in python

@theoopsiedaisiegaisi 2 жыл бұрын

Hi, i got this error Traceback (most recent call last): File "", line 1, in AttributeError: 'module' object has no attribute 'read_parquet'

@DataEngUncomplicated Жыл бұрын

Hi, did you import AWS Wrangler correctly?

@theoopsiedaisiegaisi Жыл бұрын

@@DataEngUncomplicated may i know if you have any video on how to install it?

@DataEngUncomplicated Жыл бұрын

Wait sorry this video uses Pandas, I confused it with another video :). Yes checkout this video here to install pandas if you haven't already: kzfaq.info/get/bejne/jqx_aM2VrNmxlZ8.html