Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 451EB200CC3 for ; Sat, 15 Jul 2017 15:45:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 4385716971C; Sat, 15 Jul 2017 13:45:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (unknown [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 62EC1169716 for ; Sat, 15 Jul 2017 15:45:15 +0200 (CEST) Received: (qmail 29583 invoked by uid 500); 15 Jul 2017 13:45:09 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 29573 invoked by uid 99); 15 Jul 2017 13:45:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Jul 2017 13:45:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 0D2441806CC for ; Sat, 15 Jul 2017 13:45:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.479 X-Spam-Level: ** X-Spam-Status: No, score=2.479 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gridgain-com.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id rAmu0snoTkti for ; Sat, 15 Jul 2017 13:45:07 +0000 (UTC) Received: from mail-qk0-f182.google.com (mail-qk0-f182.google.com [209.85.220.182]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 972165F6BF for ; Sat, 15 Jul 2017 13:45:07 +0000 (UTC) Received: by mail-qk0-f182.google.com with SMTP id a66so80235201qkb.0 for ; Sat, 15 Jul 2017 06:45:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gridgain-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=hhLbvMHQdp0ZzHy+fNAkgGWrISg3fWNdK3yeCOLh9D4=; b=Ir54GIEHiKk7E9DD1tPxCBS+NdS0ReDjgb3c14Pa5NixeueR7NjVcA/dpmuB+ZP6dw jFs0m9qsmDTN5ecaAngOtmKA2KCkB6taW1rW1NIW0wRsipxxr/1NlktmycshjqCoAU3r v25fKWtBU6e4A2qiVehFRBCYmD/TcS4uQUNShuY4LoOaBxwISW29znN0V4yfpk2hWW6K WGkgLlXeYsFKtsxoCWo3oyqiifbs7M+R9oL7QqMxeiTRngkgcafiVfEOimq+vvrdgm8u c/p2O4zkp+2V2KCa8R3OIPbHFgVHev251x54OAN4GwpfPZj0M64loLbaFQb0VOpGWQu8 63wA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=hhLbvMHQdp0ZzHy+fNAkgGWrISg3fWNdK3yeCOLh9D4=; b=XQvrYoWvetsLlleqdlQoZQoCsIiZBYErW3Pmbm4H1GVx5l9v/iuITCqMl7ATYxTeNR OKMHCQ05ugExXOOdhL7KSSzR7l+YCW+Qct8qM5wuxNRNwBzl3tQ9jJumhthNCExxfzrx A4x8nN3vlWB8Szzu6gimVQe300xZXrNHWvGuKm0ke9iVIggqt06Y+OaBfQq26X3EbtJK Ytv1MX4Q8eut9w3AACb1MEYsa4sf+BjzHZAM8e25Itd9sw3LorKRk2NrPgOYmvIoPMaW np1LSGr8B9VG0iVvzEN0Oa/Zbuaagh9yEb+jUuZZmUe+/Mgr91R7sIMSRfO921rTfP7Q oMgg== X-Gm-Message-State: AIVw113dkeZOYU8yC4VCXJXl5B4HoOjJB115unmZoQICnHnxB/3TfhW/ DWWA9Nv1Ob4FpPgcbIxFHDPuiL7+aidCSo0= X-Received: by 10.55.178.135 with SMTP id b129mr16794333qkf.189.1500126306989; Sat, 15 Jul 2017 06:45:06 -0700 (PDT) MIME-Version: 1.0 Received: by 10.12.157.239 with HTTP; Sat, 15 Jul 2017 06:45:06 -0700 (PDT) In-Reply-To: <3c632d75.3bb6.15d4567838b.Coremail.wanxing987@163.com> References: <772fe87a.8222.15d35d026e7.Coremail.wanxing987@163.com> <1499849636783-14710.post@n6.nabble.com> <3c632d75.3bb6.15d4567838b.Coremail.wanxing987@163.com> From: Denis Magda Date: Sat, 15 Jul 2017 06:45:06 -0700 Message-ID: Subject: Re: Requested array size exceeds VM limit To: "user@ignite.apache.org" Content-Type: multipart/alternative; boundary="94eb2c060d82a58dd705545b5f5b" archived-at: Sat, 15 Jul 2017 13:45:16 -0000 --94eb2c060d82a58dd705545b5f5b Content-Type: text/plain; charset="UTF-8" Starting Ignite 2.0 data is always in off-heap meaning you can easily store and process terabytes of data in the cluster. Java heap is needed only for operational needs of your application (not as data storage). Start with some value around a couple of gigabytes and increase if the workload requires more. Denis On Saturday, July 15, 2017, Lucky wrote: > > OK .I see. > But My data is more than 80GB, and it will rise to 120G the next 3 years, > and I want to let my data always resides in off heap. > My ignite version is 2.0. > Any suggestion? > > > Thanks. > Lucky > > > > At 2017-07-14 21:27:21, "Andrey Mashenkov" > wrote: > > Hi Lucky, > > It is a bad practice to set JVM memory >= 32GB. Usually, you can get a > performance degradation for heap > 10Gb due to heavy GC. > Also it make no sense to have different Xms and Xmx params on server side > as, JVM never revert back free memory to OS. > > From ignite-2.x there is no need to have huge heap as all your data will > always resides in off heap. > For 1.x versions, you can add more nodes with smaller heap or use OffHeap > memory mode. > > See recommended settings [1]. > > [1] https://apacheignite.readme.io/docs/jvm-and-system-tuning > > On Thu, Jul 13, 2017 at 5:02 AM, Lucky > wrote: > >> Actually,my setting is : Xms =40G,Xmx =120G. >> but it still got the wrong message. >> Are there another parameters about H2 console? >> >> Thanks. >> Lucky >> >> >> At 2017-07-12 16:53:56, "Humphrey" > wrote: >> >You can modify the ignite.sh script and increase the Xms and values >> > >> > >> > >> > >> > >> >-- >> >View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Requested-array-size-exceeds-VM-limit-tp14708p14710.html >> >Sent from the Apache Ignite Users mailing list archive at Nabble.com. >> >> >> >> >> > > > > -- > Best regards, > Andrey V. Mashenkov > > > > > --94eb2c060d82a58dd705545b5f5b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Starting Ignite 2.0 data is always in off-heap meaning you can easily store= and process terabytes of data in the cluster.

Java heap= is needed only for operational needs of your application (not as data stor= age). Start with some value around a couple of gigabytes and increase if th= e workload requires more.=C2=A0

Denis

On Sa= turday, July 15, 2017, Lucky <wanx= ing987@163.com> wrote:

OK .I see.
But My data is more than 80GB, and it will rise to 1= 20G =C2=A0the next 3 years, =C2=A0and =C2=A0 I want to let my =C2=A0data al= ways resides in off heap.
My ignite version is 2.0.
Any= suggestion?


Thanks.
Luck= y



At 2017-07-14 21:= 27:21, "Andrey Mashenkov" <andre= y.mashenkov@gmail.com> wrote:
H= i Lucky,

It is a bad practice to set JVM memory >=3D = 32GB. Usually, you can get a performance degradation for heap > 10Gb due= to heavy GC.
Also it make no sense to have different Xms and Xmx= params on server side as, JVM never revert back free memory to OS.

From ignite-2.x there is no need to have huge heap as all your data = will always resides in off heap.
For 1.x versions, you can add mo= re nodes with smaller heap or use OffHeap memory mode.

=
See recommended settings [1].


On= Thu, Jul 13, 2017 at 5:02 AM, Lucky <wanxing987@163.com> wrote:
Actually,my setting is :=C2=A0Xms =3D40G,Xmx =3D120G.
but it still got the wrong message.<= /div>
Are the= re another parameters about H2 console?

Thanks.<= /font>
Lucky

At 201=
7-07-12 16:53:56, "Humphrey" <hmmlopez@g=
mail.com> wrote:
>You can modify the ignite.sh script and increase the Xms and values
>
>
>
>
>
>--
>View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Reque=
sted-array-size-exceeds-VM-limit-tp14708p14710.html
>Sent from the Apache Ignite Users mailing list archive at Nabble.com.


=C2=A0




--
Best regards,
Andrey V. Mas= henkov


=C2=A0

--94eb2c060d82a58dd705545b5f5b--