MATLAB Answers

Reading large gz files without unzip

37 views (last 30 days)
Davide
Davide on 23 Jun 2015
Commented: Sivakandan Mani on 26 May 2019
I need to go into a very large dataset that is made of many large .gz files (each of 1GB). In the UNIX shell it is possible to explore them without unzipping using the command:
gzcat
Is there something equivalent for Matlab?

  0 Comments

Sign in to comment.

Answers (2)

Jan
Jan on 23 Jun 2015
Edited: Jan on 23 Jun 2015
What about
system('gzcat ...')
?

  3 Comments

Davide
Davide on 23 Jun 2015
Yes, this is a possibility, nevertheless the "system" command does not generate a stream that Matlab can manage.
Jan
Jan on 23 Jun 2015
You want to "explore" the files. So why do you need to create a "stream"?
Davide
Davide on 23 Jun 2015
Sorry, probably I did not explain very well what I have to do. It deals with financial data, each gz file has the structure (I am attaching only the first two lines)
#RIC,Date[G],Time[G],GMT Offset,Type,Price,Volume,Bid Price,Ask Price,Exch Time
A.N,18-FEB-2014,14:31:00.610,-5,Trade,55.47,48939,,,14:31:00.565
A.N,18-FEB-2014,14:31:00.610,-5,Quote,,,55.43,55.47,
and I want to, for example, interpolate the column "Price" on a fixed time grid, using previous tick interpolation. So I need to use for loops to operate on the file.

Sign in to comment.


Walter Roberson
Walter Roberson on 23 Jun 2015

  2 Comments

Davide
Davide on 24 Jun 2015
I'll try, thank you very much.
Sivakandan Mani
Sivakandan Mani on 26 May 2019
Hi Davide,
could you processes your data in matlab,
I have similar kind of problem. If you dont mind could you help me?
With regards,
Siva

Sign in to comment.


Translated by