Mailing-List: contact user-help@ignite.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@ignite.apache.org
From: Denis Magda <dmagda@gridgain.com>
Content-Type: multipart/alternative; boundary="Apple-Mail=_0DA69D5E-A76F-4194-8F55-42CCBA9CF2BA"
Message-Id: <E402654D-1BED-4D26-9062-FCE300E3AC74@gridgain.com>
Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\))
Subject: Re: System.exit() not exiting cleanly (locked on IgnitionEx$IgniteNamedInstance)
Date: Fri, 24 Jun 2016 16:56:06 +0300
References: <1466651475171-5814.post@n6.nabble.com> <1466765090153-5870.post@n6.nabble.com> <1466771407407-5876.post@n6.nabble.com>
To: user@ignite.apache.org
In-Reply-To: <1466771407407-5876.post@n6.nabble.com>
archived-at: Fri, 24 Jun 2016 13:56:13 -0000


--Apple-Mail=_0DA69D5E-A76F-4194-8F55-42CCBA9CF2BA
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=utf-8

Please provide full thread dumps from all the nodes at the time it =
happens again.
In particular I=E2=80=99m interested in what is going with the thread =
named "ipc-shmem-gc=E2=80=9D. In addition to the thread dumps attache =
the logs from all the nodes for investigation.

As a workaround you can disable shmem as it was suggested before. =
Finally I would recommend upgrading to the latest Ignite 1.6.0 version.

=E2=80=94
Denis

> On Jun 24, 2016, at 3:30 PM, bintisepaha <binti.sepaha@tudor.com> =
wrote:
>=20
> JDK 1.7, 16 node cluster, each JVM 10 GB heap and 4 GB off heap. 4 =
nodes run
> on 4 linux boxes, each box has 64 GB memory. the heap is =
under-utilized when
> this happens. so doubt GC will cause it.
> multiple clients connect to it. clients cannot exit properly either =
with
> System.exit() or Ignition.stop().
>=20
> We did not have the issue on our end until this week, but then =
something
> could have changed with ports in our environment. We cannot reproduce
> ourselves in UAT it only happens for us in Production.
>=20
>=20
>=20
>=20
>=20
> --
> View this message in context: =
http://apache-ignite-users.70518.x6.nabble.com/System-exit-not-exiting-cle=
anly-locked-on-IgnitionEx-IgniteNamedInstance-tp5814p5876.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.


--Apple-Mail=_0DA69D5E-A76F-4194-8F55-42CCBA9CF2BA
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=utf-8

<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html =
charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" =
class=3D"">Please provide <b class=3D"">full</b> thread dumps from all =
the nodes at the time it happens again.<div class=3D"">In particular =
I=E2=80=99m interested in what is going with the thread named =
"ipc-shmem-gc=E2=80=9D. In addition to the thread dumps attache the logs =
from all the nodes for investigation.</div><div class=3D""><br =
class=3D""></div><div class=3D"">As a workaround you can disable shmem =
as it was suggested before. Finally I would recommend upgrading to the =
latest Ignite 1.6.0 version.</div><div class=3D""><br =
class=3D""></div><div class=3D"">=E2=80=94</div><div =
class=3D"">Denis</div><div class=3D""><br class=3D""><div><blockquote =
type=3D"cite" class=3D""><div class=3D"">On Jun 24, 2016, at 3:30 PM, =
bintisepaha &lt;<a href=3D"mailto:binti.sepaha@tudor.com" =
class=3D"">binti.sepaha@tudor.com</a>&gt; wrote:</div><br =
class=3D"Apple-interchange-newline"><div class=3D""><div class=3D"">JDK =
1.7, 16 node cluster, each JVM 10 GB heap and 4 GB off heap. 4 nodes =
run<br class=3D"">on 4 linux boxes, each box has 64 GB memory. the heap =
is under-utilized when<br class=3D"">this happens. so doubt GC will =
cause it.<br class=3D"">multiple clients connect to it. clients cannot =
exit properly either with<br class=3D"">System.exit() or =
Ignition.stop().<br class=3D""><br class=3D"">We did not have the issue =
on our end until this week, but then something<br class=3D"">could have =
changed with ports in our environment. We cannot reproduce<br =
class=3D"">ourselves in UAT it only happens for us in Production.<br =
class=3D""><br class=3D""><br class=3D""><br class=3D""><br class=3D""><br=
 class=3D"">--<br class=3D"">View this message in context: <a =
href=3D"http://apache-ignite-users.70518.x6.nabble.com/System-exit-not-exi=
ting-cleanly-locked-on-IgnitionEx-IgniteNamedInstance-tp5814p5876.html" =
class=3D"">http://apache-ignite-users.70518.x6.nabble.com/System-exit-not-=
exiting-cleanly-locked-on-IgnitionEx-IgniteNamedInstance-tp5814p5876.html<=
/a><br class=3D"">Sent from the Apache Ignite Users mailing list archive =
at <a href=3D"http://nabble.com" class=3D"">Nabble.com</a>.<br =
class=3D""></div></div></blockquote></div><br =
class=3D""></div></body></html>=

--Apple-Mail=_0DA69D5E-A76F-4194-8F55-42CCBA9CF2BA--