Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5DFAF200C28 for ; Mon, 13 Mar 2017 11:58:40 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 5C8F3160B60; Mon, 13 Mar 2017 10:58:40 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 595F6160B6C for ; Mon, 13 Mar 2017 11:58:39 +0100 (CET) Received: (qmail 36280 invoked by uid 500); 13 Mar 2017 10:58:32 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 36270 invoked by uid 99); 13 Mar 2017 10:58:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 13 Mar 2017 10:58:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 229E91803A1 for ; Mon, 13 Mar 2017 10:58:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.898 X-Spam-Level: ** X-Spam-Status: No, score=2.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id DflI2l0Mx8kj for ; Mon, 13 Mar 2017 10:58:28 +0000 (UTC) Received: from mail-io0-f174.google.com (mail-io0-f174.google.com [209.85.223.174]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 69C365F2EF for ; Mon, 13 Mar 2017 10:58:27 +0000 (UTC) Received: by mail-io0-f174.google.com with SMTP id z13so81641524iof.2 for ; Mon, 13 Mar 2017 03:58:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=YXIUNl3x6ZMNp0+DRMZ19QXr/thOmVBN6OlxqLDNWLk=; b=tPqgxZrvwVS368Vl9m55fNQ4ylsyH5QLWqOYlw/gC2PICSCEOyyWEDRLdBHdMxhjgR J48WCSI4xp+y+YgL6NJjO7/nPH5f+QhjX9yPdInOzibrM4uFAgMdXfQGa3xbOl4Le3SU GcWoPcYRLuH+aDCmcN8IuWIbn3x+fem+B9dJRpvlg0EsF3N3Mik6ehQ4KJKdi74+gIRJ AFfbDcDTwjAL+V421l8x3AO+s21fGYdR9noJ8nh/sc6e8byFuXj2zL79oTgN4U3hGsIo 9AM0NbogmH2Gf4zfCyOKBnz5CpijvfEC7l+UmLYbZMwyBLkUwdE24l7YSrXPiKaDSK83 3uFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=YXIUNl3x6ZMNp0+DRMZ19QXr/thOmVBN6OlxqLDNWLk=; b=uJxQYdNnKkg9GBmr7UScHoNcu4qfpJK9KGkNX7hzOW8Iz6qD1VuA3nf1f97GcTQSje 0Vti+ec9DzmtQ+PNzWCCL3OXQLPCm6KYWS7CutpzsTDDZj0dK3ugJzFQqIE7LriKuK/U vgmvMvpl0e+Glj+QOkAd71a9yg5lsio8aSZDpzAVCjiztfkMwPMsrJ/GJzeMAYbRtDJP k9xCxTjo7LpZ+ovo6OQBnC044Qsnw7Oo+395PHj1SKIYbXEQuBPjw77UrGJLq8z2/UkK lDT+n01RaeHcOYvrm2jHmHrcTw/Xn1sk2b4PZw8nsRfcNyMauGE7jC/Fz8gHkI+bqenI JVHQ== X-Gm-Message-State: AMke39mWyHBJ8QOgGnK+C5m5xff/+VZQOIY4ja/d0yv/hKoLfn15wP386HRHiprq8P6ft6paxp4qH2bpvlhmcg== X-Received: by 10.107.169.201 with SMTP id f70mr31751769ioj.161.1489402302756; Mon, 13 Mar 2017 03:51:42 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.133.6 with HTTP; Mon, 13 Mar 2017 03:51:02 -0700 (PDT) In-Reply-To: References: From: Anil Date: Mon, 13 Mar 2017 16:21:02 +0530 Message-ID: Subject: Re: IGNITE-4106 To: user@ignite.apache.org Content-Type: multipart/alternative; boundary=001a114279b42efff4054a9a7f57 archived-at: Mon, 13 Mar 2017 10:58:40 -0000 --001a114279b42efff4054a9a7f57 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Andrey, Did you get a chance to look into the reproducer ? thanks. Thanks. On 11 March 2017 at 17:37, Andrey Mashenkov wrote: > Thanks Anil. > > I'll take a look. > > 11 =D0=BC=D0=B0=D1=80=D1=82=D0=B0 2017 =D0=B3. 9:58 =D0=BF=D0=BE=D0=BB=D1= =8C=D0=B7=D0=BE=D0=B2=D0=B0=D1=82=D0=B5=D0=BB=D1=8C "Anil" =D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB: > > Hi Andrey, > > i am able to reproduce the issue with following reproducer. > > https://github.com/adasari/test-ignite-parallelism.git > > Please let me know if you see any issue with reproducer. > > Thanks > > On 11 March 2017 at 11:46, Anil wrote: > >> Hi Andrey, >> >> i have created test project which pushes the entries to drastreamer usin= g >> for loop and it is working without any issue. >> >> But my application which does the same thing but loads the data from >> hbase and it is failing with *"java.lang.IllegalStateException: Data >> streamer has been closed." * >> >> >> >> *java.lang.IllegalStateException: Data streamer has been closed. >> at org.apache.ignite.internal.pro >> cessors.datastreamer.DataStreamer= Impl.enterBusy(DataStreamerImpl.java:406) >> at org.apache.ignite.internal.pro >> cessors.datastreamer.DataStreamer= Impl.addDataInternal(DataStreamerImpl.java:613) >> at org.apache.ignite.internal.pro >> cessors.datastreamer.DataStreamer= Impl.addData(DataStreamerImpl.java:667)* >> >> i set the system and public thread pool as 32 for an 8 core machine and >> using 4 node cluster. >> >> and i see that loading data into cache for which queryParallelism >> configured is failing and other cache loads working fine. >> >> Thanks >> >> >> On 10 March 2017 at 05:05, Andrey Mashenkov >> wrote: >> >>> Hi Anil, >>> >>> I don't think it is a thead starvation due to it work fine for 1 thread= . >>> Whould you please share a repro? >>> >>> On Thu, Mar 9, 2017 at 9:09 PM, Anil wrote: >>> >>>> >>>> Hi Andrey, >>>> >>>> i tried to set the parallelism to 2, 4 on 4 node cluster (8 core >>>> machines) and initiated the data load (using compute job). Data stream= ers >>>> are getting closed and data load is failing. >>>> >>>> When I set the parallelism to 1, data load working as expected. the >>>> issue could be threads starvation/ non availability of resources and n= ot >>>> ignite issue. Do you think any other issue ? >>>> >>>> I will try on 16 core machines cluster tomorrow. >>>> >>>> Thanks. >>>> >>>> On 8 March 2017 at 18:04, Andrey Mashenkov >>>> wrote: >>>> >>>>> Hi Anil, >>>>> >>>>> SQL queries are run in system pool. >>>>> >>>>> On Wed, Mar 8, 2017 at 3:04 PM, Anil wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> Does queryparallelism uses system pool or separate thread pool other >>>>>> than system and public thread pool ? please clarify. >>>>>> >>>>>> 1. https://apacheignite.readme.io/docs/sql-performance-and-d >>>>>> ebugging#sql-performance-and-usability-considerations >>>>>> >>>>>> Thanks. >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Best regards, >>>>> Andrey V. Mashenkov >>>>> >>>> >>>> >>> >>> >>> -- >>> Best regards, >>> Andrey V. Mashenkov >>> >> >> > > --001a114279b42efff4054a9a7f57 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Andrey,

Did you get a chance to look= into the reproducer ? thanks.

Thanks.
=

On 11 March 2017 = at 17:37, Andrey Mashenkov <andrey.mashenkov@gmail.com> wrote:
Thanks= Anil.

I'll take a l= ook.

11 =D0=BC=D0=B0=D1=80=D1=82=D0=B0 2017 =D0=B3. 9:58 =D0=BF=D0=BE=D0=BB= =D1=8C=D0=B7=D0=BE=D0=B2=D0=B0=D1=82=D0=B5=D0=BB=D1=8C "Anil" <= ;anilklce@gmail.com= > =D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0=D0=BB:
Hi And= rey,

i am able to reproduce the issue with followi= ng reproducer.


Please = let me know if you see any issue with reproducer.

= Thanks

On 11 March 2017 at 11:46, = Anil <anilklce@gmail.com> wrote:
Hi Andrey,

i have created test = project which pushes the entries to drastreamer using for loop and it is wo= rking without any issue.

But my application which = does the same thing but loads the data from hbase and it is failing with "java.lang.IllegalStateException: Data streamer has been closed.= "=C2=A0

java.lang.IllegalStateException: Data streame= r has been closed.

=C2=A0 =C2=A0 =C2=A0 =C2=A0 at <= a href=3D"http://org.apache.ignite.internal.pro" target=3D"_blank">org.apac= he.ignite.internal.processors.datastreamer.DataStreamerImpl.e= nterBusy(DataStreamerImpl.java:406)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 at = org.apache.ignite.internal.processors.datastreamer.DataStream= erImpl.addDataInternal(DataStreamerImpl.java:613)
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 at org.apache.ignite.internal.processors.datastreamer.D= ataStreamerImpl.addData(DataStreamerImpl.java:667)

=

i set the system and public thre= ad pool as 32 for an 8 core machine and using 4 node cluster.
and i see that loading data into cache for which queryParalleli= sm configured is failing and other cache loads working fine.

=
Thanks


=
On 10 March 2017 at 05:05, Andrey Mashenkov <andrey.mashenkov@gmail.com> wrote:
Hi Anil,

I don't thi= nk it is a thead starvation due to it work fine for 1 thread.
Who= uld you please share a repro?

On Thu, Mar 9, 2017 at 9:09 PM, Anil <anilklce@gm= ail.com> wrote:

Hi Andrey,

i tried to set the paral= lelism to 2, 4 on 4 node cluster (8 core machines) and initiated the data l= oad (using compute job). Data streamers are getting closed and data load is= failing.=C2=A0

When I set the parallelism to 1, d= ata load working as expected. the issue could be threads starvation/ non av= ailability of resources and not ignite issue. Do you think any other issue = ?

I will try on 16 core machines cluster tomorrow.= =C2=A0

Thanks.
On 8 March 2017 at 18:04, Andrey Mashenkov <andrey.mashenkov@gmail.com> wrote:
Hi Anil,

SQL queries are= run in system pool.=C2=A0

On Wed, Mar 8, 2017 at 3:04 PM, Anil <anilklce@gmail= .com> wrote:
Hi,

Does queryparallelism uses system pool or separat= e thread pool other than system and public thread pool ? please clarify.





--=
Best= regards,
Andrey V. Mashenkov




--
Best= regards,
Andrey V. Mashenkov




--001a114279b42efff4054a9a7f57--