RE [scilab-Users] Re: 500mo Ascii file

[Michael BAUDIN]

Hi,

You cannot read one line every 100 lines. But what you can do (and this is 
more interesting) is to read your files by blocks: this is the "range" 
option.

See this post :

http://www.equalis.com/forums/posts.asp?topic=169983

This should allow you to read huge files.

Best regards,

Michaël







remi.mercier at imelavi.fr 
16/06/2012 17:06
Veuillez répondre à
users at lists.scilab.org


A
users at lists.scilab.org
cc

Objet
[scilab-Users] Re: 500mo Ascii file






Hello all,

Following the "success" of reading a big file (around 200mo) I tried with
bigger files ;-)
Although I waited more than 5 minutes I was not able to load a 500mo file.

So I wanted to only load 1 line every 100 but I did not find a good
technique.
I was thinking doing something like this (I noticed that a line as a
"length" of 41 or 42) :

f=mopen('my500mofile.txt','r');
data=[];eof=0;
While eof==0, data=[data;mgetl(f,1)];mseek(4100,'cur'); eof=meof(f);,end;


mseek(4100,'cur'); should skip 100 line but the problem is that sometimes
4100 does not exactly correspond to exactly 100 lines and it messed up the
result.....

Any idee to avoid this?

Thx you a lot and have a good week-end,
Rémi

--
View this message in context: 
http://mailinglists.scilab.org/500mo-Ascii-file-tp4024324p4024379.html
Sent from the Scilab users - Mailing Lists Archives mailing list archive 
at Nabble.com.

--
To unsubscribe from this mailing-list, please send an empty mail to
users-unsubscribe at lists.scilab.org
To check the archives of this mailing list, see
http://mailinglists.scilab.org/





Ce message et toutes les pièces jointes (ci-après le 'Message') sont établis à l'intention exclusive des destinataires et les informations qui y figurent sont strictement confidentielles. Toute utilisation de ce Message non conforme à sa destination, toute diffusion ou toute publication totale ou partielle, est interdite sauf autorisation expresse.

Si vous n'êtes pas le destinataire de ce Message, il vous est interdit de le copier, de le faire suivre, de le divulguer ou d'en utiliser tout ou partie. Si vous avez reçu ce Message par erreur, merci de le supprimer de votre système, ainsi que toutes ses copies, et de n'en garder aucune trace sur quelque support que ce soit. Nous vous remercions également d'en avertir immédiatement l'expéditeur par retour du message.

Il est impossible de garantir que les communications par messagerie électronique arrivent en temps utile, sont sécurisées ou dénuées de toute erreur ou virus.
____________________________________________________

This message and any attachments (the 'Message') are intended solely for the addressees. The information contained in this Message is confidential. Any use of information contained in this Message not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval.

If you are not the addressee, you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return message.

E-mail communication cannot be guaranteed to be timely secure, error or virus-free.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.scilab.org/pipermail/users/attachments/20120618/032ee432/attachment.htm>