[Scilab-users] [EXTERNAL] Re: feedback on removing 1 row and 1 column

[Carrico, Paul]

Thanks Stéphane for your support

Paul

De : users [mailto:users-bounces at lists.scilab.org] De la part de Stéphane Mottelet
Envoyé : vendredi 3 mai 2019 14:35
À : users at lists.scilab.org
Objet : Re: [Scilab-users] [EXTERNAL] Re: feedback on removing 1 row and 1 column

Hello Paul,

A fix is under review for master at https://codereview.scilab.org/#/c/20965/<https://urldefense.proofpoint.com/v2/url?u=https-3A__codereview.scilab.org_-23_c_20965_&d=DwMD-g&c=0hKVUfnuoBozYN8UvxPA-w&r=2R_Eyw3woK4XVPnEug_8oZFQfCE8Ul6UYufxQizYx6k&m=VqyKaR193dESQu5tjaSxhI_TxGd3wG2--Wc2XKjfM_E&s=kb-kZMye_5VnWJlIio3o-IPg95SyG_5m_DrfMy59Rks&e=>, I hope it will be reviewed and merged soon (timings are done on my machine, an old mid-2010 MacPro) :

--> MAT=rand(2.3e6,6);
--> tic;MAT(:,$)=[];toc
 ans  =

   0.051402

--> MAT=rand(2.3e6,6);
--> tic;MAT(:,[1 3])=[];toc
  ans  =

   0.046928

S.

Le 30/04/2019 à 14:04, Carrico, Paul a écrit :
Thanks all

Indeed, getting the complete block works fine and it's instantaneous

Paul

De : users [mailto:users-bounces at lists.scilab.org] De la part de Stéphane Mottelet
Envoyé : mardi 30 avril 2019 12:41
À : users at lists.scilab.org<mailto:users at lists.scilab.org>
Objet : [EXTERNAL] Re: [Scilab-users] feedback on removing 1 row and 1 column

Le 30/04/2019 à 08:44, Carrico, Paul a écrit :
Dear All

I've been using successfully Scilab for years, to develop my projects; I do not remember if I've ever had to deal with huge matrixes but that's the case today.

Using "csvRead", I got a matrix with 2.3 million of rows and 6 columns (it took about 240 seconds to read it :)); nevertheless I've been surprised when I tried to remove the first row and the last column using basically:
MAT(1,:) = []; MAT(:,$) = [];

in the meantime (before we fix this), you can do

MAT = MAT(:,1:$-1);

which will be way faster !

S.

Indeed I needed to kill the process after about 10 minutes (same result both under Windows 10 and Linux - RAM not fully used).

By comparison, the same process is instantaneous under Python using Numpy (numpy.delete) using of course the same matrix.

A feedback I wanted to share ....

PaulEXPORT CONTROL :
« Cet email ne contient pas de données techniques »
« This email does not contain technical data »






_______________________________________________

users mailing list

users at lists.scilab.org<mailto:users at lists.scilab.org>

https://antispam.utc.fr/proxy/1/c3RlcGhhbmUubW90dGVsZXRAdXRjLmZy/lists.scilab.org/mailman/listinfo/users<https://urldefense.proofpoint.com/v2/url?u=https-3A__antispam.utc.fr_proxy_2_c3RlcGhhbmUubW90dGVsZXRAdXRjLmZy_urldefense.proofpoint.com_v2_url-3Fu-3Dhttps-2D3A-5F-5Fantispam.utc.fr-5Fproxy-5F1-5Fc3RlcGhhbmUubW90dGVsZXRAdXRjLmZy-5Flists.scilab.org-5Fmailman-5Flistinfo-5Fusers-26d-3DDwMD-2Dg-26c-3D0hKVUfnuoBozYN8UvxPA-2Dw-26r-3D2R-5FEyw3woK4XVPnEug-5F8oZFQfCE8Ul6UYufxQizYx6k-26m-3D8u-5Fkv9vrBYRsyNeOuOx1-2D8PC4J3mnOk3lTxHZb9M1Ag-26s-3D3ChVco-2DXbUA6A2leK09txfCP6iuWYrDHPV0kJQ-5FfNRo-26e-3D&d=DwMD-g&c=0hKVUfnuoBozYN8UvxPA-w&r=2R_Eyw3woK4XVPnEug_8oZFQfCE8Ul6UYufxQizYx6k&m=VqyKaR193dESQu5tjaSxhI_TxGd3wG2--Wc2XKjfM_E&s=USwzfFXxjl2q6TiBJuPeEiPW0oWBm-0vuiJUFRyCKG0&e=>



--

Stéphane Mottelet

Ingénieur de recherche

EA 4297 Transformations Intégrées de la Matière Renouvelable

Département Génie des Procédés Industriels

Sorbonne Universités - Université de Technologie de Compiègne

CS 60319, 60203 Compiègne cedex

Tel : +33(0)344234688

http://www.utc.fr/~mottelet<https://urldefense.proofpoint.com/v2/url?u=https-3A__antispam.utc.fr_proxy_2_c3RlcGhhbmUubW90dGVsZXRAdXRjLmZy_urldefense.proofpoint.com_v2_url-3Fu-3Dhttp-2D3A-5F-5Fwww.utc.fr-5F-2D7Emottelet-26d-3DDwMD-2Dg-26c-3D0hKVUfnuoBozYN8UvxPA-2Dw-26r-3D2R-5FEyw3woK4XVPnEug-5F8oZFQfCE8Ul6UYufxQizYx6k-26m-3D8u-5Fkv9vrBYRsyNeOuOx1-2D8PC4J3mnOk3lTxHZb9M1Ag-26s-3DlgW8LxCQDNlDkDXz-5FlaFa3r-5FBQoToZw3IAT2XDiJNf0-26e-3D&d=DwMD-g&c=0hKVUfnuoBozYN8UvxPA-w&r=2R_Eyw3woK4XVPnEug_8oZFQfCE8Ul6UYufxQizYx6k&m=VqyKaR193dESQu5tjaSxhI_TxGd3wG2--Wc2XKjfM_E&s=_zqEBFOwW6L4kO9dyovzAWIo-L92GaEP4TZcRQPMqTI&e=>



_______________________________________________

users mailing list

users at lists.scilab.org<mailto:users at lists.scilab.org>

https://antispam.utc.fr/proxy/1/c3RlcGhhbmUubW90dGVsZXRAdXRjLmZy/lists.scilab.org/mailman/listinfo/users<https://urldefense.proofpoint.com/v2/url?u=https-3A__antispam.utc.fr_proxy_1_c3RlcGhhbmUubW90dGVsZXRAdXRjLmZy_lists.scilab.org_mailman_listinfo_users&d=DwMD-g&c=0hKVUfnuoBozYN8UvxPA-w&r=2R_Eyw3woK4XVPnEug_8oZFQfCE8Ul6UYufxQizYx6k&m=VqyKaR193dESQu5tjaSxhI_TxGd3wG2--Wc2XKjfM_E&s=5_w9kt1c9r0wdIhGFHL-RDEMO1LWu8EWE2Iwq8IaaTk&e=>



--

Stéphane Mottelet

Ingénieur de recherche

EA 4297 Transformations Intégrées de la Matière Renouvelable

Département Génie des Procédés Industriels

Sorbonne Universités - Université de Technologie de Compiègne

CS 60319, 60203 Compiègne cedex

Tel : +33(0)344234688

http://www.utc.fr/~mottelet<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.utc.fr_-7Emottelet&d=DwMD-g&c=0hKVUfnuoBozYN8UvxPA-w&r=2R_Eyw3woK4XVPnEug_8oZFQfCE8Ul6UYufxQizYx6k&m=VqyKaR193dESQu5tjaSxhI_TxGd3wG2--Wc2XKjfM_E&s=XrCQtpvVQ0pW27Rg4-T71_o0QPTCBjxyGYa8PyET-4k&e=>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.scilab.org/pipermail/users/attachments/20190503/431bcca9/attachment.htm>