extract dataset from textfile to many variables

Hi everyone, I have a textfile with N rows of data (N is very big, 45e6 for example). I would like to divide these N rows into k subsets of 1e6 rows (I suppose k is integer to simplify the problem), then save each subset to one file .mat. Could somebody show me how to code please ? Best regards, Winn

Answer 1

[Walter Roberson]

If you are using OS-X or Linux, I suggest you use the Unix-level command "split"

On MS Windows, if efficiency is important, I suggest you use perl (which is included with all MATLAB releases.) The perl code can be seen at http://www.perlmonks.org/?node_id=90768

To do it in MATLAB, I would probably suggest doing the reading using textscan() with a format of '%s' and 'Delimiter', ''

[Win co]

thank you for your answer. In fact, my problem is not how to divide the dataset, but how to save each subsets to seperate .mat

[Walter Roberson]

http://matlab.wikia.com/wiki/FAQ#How_can_I_process_a_sequence_of_files.3F

[Win co]

It's so great your help. That's exactly what I'm looking for. Thank you very much