Updated: 2022-11-19 Sat 19:42

Chunky Pandas - Read CSV in chunks

Huge CSV files are a pain to read as they start overloading RAM a lot. The read_csv function provides the ability to read a file in chunks. This is potentially helpful to perform operations on such large files in parts. I’d like to look more into what all can be done using chunking.