Loading big CSV, and laptops with 8GB doesn't work
4 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
My script loads big CSV files and processes it. But some end users said csv files bigger than 350MB won't work. Is there a way to manage the RAM issue? Can Matlab split it and load it into smaller files or is there any other ways? Thanks.
0 comentarios
Respuestas (1)
Dave Behera
el 21 de Mzo. de 2016
Hi Tina,
To read huge .csv files in MATLAB, the datastore feature may be helpful. Please see the following link: Datastore
Using a datastore, you can load a .csv file and specify how many rows to read at a time. The datastore would read only that many rows into memory, and not the entire file. This way, you won't need to split your file into multiple files.
0 comentarios
Ver también
Categorías
Más información sobre File Operations en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!