Loading big CSV, and laptops with 8GB doesn't work

My script loads big CSV files and processes it. But some end users said csv files bigger than 350MB won't work. Is there a way to manage the RAM issue? Can Matlab split it and load it into smaller files or is there any other ways? Thanks.

Answer 1

[Dave Behera]

Hi Tina,

To read huge .csv files in MATLAB, the datastore feature may be helpful. Please see the following link: Datastore

Using a datastore, you can load a .csv file and specify how many rows to read at a time. The datastore would read only that many rows into memory, and not the entire file. This way, you won't need to split your file into multiple files.