can not read this file

1 visualización (últimos 30 días)
huda nawaf
huda nawaf el 24 de Abr. de 2012
hi
I have txt file with big size (570 MB). I try to read it
by this code:
f1=fopen('d:\matlab11\bin\test1.txt');
c=textscan(f1,'%d %d %f %s %s');
fclose(f1);
c1=c{1}; c2=c{2};c3=c{3};c4=c{4};c5=c{5};
u_user=unique(c1);
u_movie=unique(c2);
%%%%%%%%%%%%%%%%
but I did not get the sme data and not all.
I tried with small part from the same data , I got correct data.
this is the sample:
852910 47995 5 2008-08-16 00:00:00
852910 49280 4.5 2008-05-05 00:00:00
852910 49325 4.5 2008-06-10 00:00:00
852910 48116 5 2008-01-12 00:00:00
how I can read this big size file?
thanks in advance
  1 comentario
Oleg Komarov
Oleg Komarov el 24 de Abr. de 2012
Then the file could be corrupt, check it from where you stopped reading it.

Iniciar sesión para comentar.

Respuestas (1)

Ken Atwell
Ken Atwell el 24 de Abr. de 2012
textscan can return a second output, "pos", which will return the position that textscan stopped at if an error occurred (which seems to be the case here). You can also determine where the error is by the length of what textscan managed return in the first output. If you text file is, say, 10000 row long and c{1} is only 1234 rows long, your error is around that row.
  1 comentario
huda nawaf
huda nawaf el 25 de Abr. de 2012
thanks,
in fact it is not error but when need see c1
i get Empty matrix: 0-by-1
the no. of rows is 8196077.
I would like to say that my code can read the same file (the same no. of rows) but with three columns correctly .why when be five columns with same no. of rows get empty matrix?

Iniciar sesión para comentar.

Categorías

Más información sobre Large Files and Big Data en Help Center y File Exchange.

Etiquetas

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by