Mailing-List: contact user-help@predictionio.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@predictionio.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <CAKCZE2Jy0jcz8ScPR7+cin5ts+UT1-mkXisXNZ7PvV92Ovk2hA@mail.gmail.com>
References: <CAKCZE2Jy0jcz8ScPR7+cin5ts+UT1-mkXisXNZ7PvV92Ovk2hA@mail.gmail.com>
From: Donald Szeto <donald@apache.org>
Date: Tue, 5 Sep 2017 10:59:16 -0700
Message-ID: <CAD8z1JL+TMXjDiw1ZF0-Z6fj8EWD1A+8JmgTQgJsexS1Ge7d4A@mail.gmail.com>
Subject: Re: [ERROR] [LocalFSModels] Requested array size exceeds VM limit
To: user@predictionio.incubator.apache.org
Content-Type: multipart/alternative; boundary="94eb2c19f55a8bf363055874fd95"
archived-at: Tue, 05 Sep 2017 17:59:45 -0000

--94eb2c19f55a8bf363055874fd95
Content-Type: text/plain; charset="UTF-8"

Hi Abhimanyu,

Have you try giving the JVM a larger heap memory, e.g. pio deploy --
--driver-memory 4g

Regards,
Donald

On Tue, Aug 29, 2017 at 9:06 AM, Abhimanyu Nagrath <
abhimanyunagrath@gmail.com> wrote:

> Hi ,
> I am new to predictionIo I am using template https://github.com/
> alexice/template-scala-parallel-svd-item-similarity. I have 403K items to
> train which contains 7 Numerical fields 5 categorical fields in my
> engine.json I have set dimension:500 .and System COnfig is (30 GB RAM , 4
> Cores). after build and training at the time of deploying I am getting the
> error :
>  [ERROR] [LocalFSModels] Requested array size exceeds VM limit
>  [ERROR] [OneForOneStrategy] None.get
>
> Any suggestion how to resolve this error.
>
>
> Regards,
> Abhimanyu
>
>

--94eb2c19f55a8bf363055874fd95
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Abhimanyu,<div><br></div><div>Have you try giving the J=
VM a larger heap memory, e.g. pio deploy -- --driver-memory 4g</div><div><b=
r></div><div>Regards,</div><div>Donald</div></div><div class=3D"gmail_extra=
"><br><div class=3D"gmail_quote">On Tue, Aug 29, 2017 at 9:06 AM, Abhimanyu=
 Nagrath <span dir=3D"ltr">&lt;<a href=3D"mailto:abhimanyunagrath@gmail.com=
" target=3D"_blank">abhimanyunagrath@gmail.com</a>&gt;</span> wrote:<br><bl=
ockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #=
ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi ,=C2=A0<div>I am new to pre=
dictionIo=C2=A0I am using template=C2=A0<a href=3D"https://github.com/alexi=
ce/template-scala-parallel-svd-item-similarity" target=3D"_blank">https://g=
ithub.com/<wbr>alexice/template-scala-<wbr>parallel-svd-item-similarity</a>=
. I have 403K items to train which contains 7 Numerical fields 5 categorica=
l fields in my engine.json=C2=A0I have set dimension:500 .and System COnfig=
 is (30 GB RAM ,=C2=A04 Cores). after build and training at the time of dep=
loying I am getting the error :</div><div>=C2=A0[ERROR] [LocalFSModels] Req=
uested array size exceeds VM limit=C2=A0</div><div>=C2=A0[ERROR] [OneForOne=
Strategy] None.get</div><div><br></div><div>Any suggestion how to resolve t=
his error.</div><div><br></div><div><br></div><div>Regards,</div><div>Abhim=
anyu=C2=A0</div><div><br></div></div>
</blockquote></div><br></div>

--94eb2c19f55a8bf363055874fd95--