Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B087E200BF5 for ; Sat, 3 Dec 2016 04:20:04 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id AF54D160AF6; Sat, 3 Dec 2016 03:20:04 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D793F160B24 for ; Sat, 3 Dec 2016 04:20:03 +0100 (CET) Received: (qmail 46738 invoked by uid 500); 3 Dec 2016 03:20:03 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 46658 invoked by uid 99); 3 Dec 2016 03:20:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Dec 2016 03:20:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 706871A03BE for ; Sat, 3 Dec 2016 03:20:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.399 X-Spam-Level: ** X-Spam-Status: No, score=2.399 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 3vWGuQQyXu9Y for ; Sat, 3 Dec 2016 03:20:00 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 5667E5FBC4 for ; Sat, 3 Dec 2016 03:20:00 +0000 (UTC) Received: by mail-io0-f173.google.com with SMTP id m5so376897546ioe.3 for ; Fri, 02 Dec 2016 19:20:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=8vmR9SyHdRF3me6Tw6cuL07zlotxVqbqrVfW1pJCvw8=; b=t8UQ4g6Jw4ch+Shm3+lkIHQDVIzW64q7aN0X6cH6djh+owRdyG2hy9v1FPo3/Sm+sv dVPVq8VoBCRQZIPhu857zXm1wn7rAetABFyLRA9sp7hGb7wYd5/5LCZrL5g0ReTem2by GIGo8QM0XQPIdFXC2bOlu9UpJFbw+XH8dtFYIbWaVKaru2JPtWd/RhUizdbCnEEv5og2 VGDNjDBSXTYn/6ndQnn3cBv9H+BhH3RPBO+FY4e6bhZr7fDBVJNd4rf1bYPOjAtGS36l QjMh5JIzqPk3nPtvDVXJQWmMjRdS0YukLfxJxV93JuzL4UuPOh8EUpUp5va9PedaZ72F X/Kg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=8vmR9SyHdRF3me6Tw6cuL07zlotxVqbqrVfW1pJCvw8=; b=Kf5W+7fvCx+9rO95BU+C5bxupRe35vXP1UtyQbiwxa4iaJn7etRfhkvHvy6qV4aOKT by+570KSqv0TUlYy5lmUQOfm84H4mrz1f+qBzkNsOZbSIXNiW2Cn5lPDBdD0SD1HAbP2 zhbOGbOVsuBLOaYaVrr6btwIoYFrd7JGzssOx1jsW8Ir/ihMfmCrZ9UpDMCwaeEjZwmy 2K2e2pnqLadbLFpYysXHOvIe6C94euejk+T8eanRJCR+FNw6osHnFNr3x1irpyT5GiOz CkNVfNgXUWtcz056VOES/6Fz+sHKl+VsUX4W81bo7KyxC86L0BcT0M83EJNSmUJWiLb+ x3fQ== X-Gm-Message-State: AKaTC00Dvx7QBeglihNcxU6nfmVBQf917x4430tUzqamn9ISUkT59hmXXRKFWRfNEl/6ygU7bFBfiecmopYXmw== X-Received: by 10.36.123.82 with SMTP id q79mr308464itc.25.1480735199645; Fri, 02 Dec 2016 19:19:59 -0800 (PST) MIME-Version: 1.0 Received: by 10.107.59.15 with HTTP; Fri, 2 Dec 2016 19:19:19 -0800 (PST) In-Reply-To: <1480700876885-9373.post@n6.nabble.com> References: <1480444341175-9272.post@n6.nabble.com> <1480547090683-9313.post@n6.nabble.com> <1480632087349-9342.post@n6.nabble.com> <1480700876885-9373.post@n6.nabble.com> From: Anil Date: Sat, 3 Dec 2016 08:49:19 +0530 Message-ID: Subject: Re: Fetching large number of records To: user@ignite.apache.org Content-Type: multipart/alternative; boundary=001a11474ba494d5b40542b887ae archived-at: Sat, 03 Dec 2016 03:20:04 -0000 --001a11474ba494d5b40542b887ae Content-Type: text/plain; charset=UTF-8 Hi Val, Thanks for clarification. I understand something and i will give a try. Thanks. On 2 December 2016 at 23:17, vkulichenko wrote: > Anil, > > The JdbcQueryTask is executed each time the next page is needed. And the > number of rows returned by the task is limited by fetchSize: > > if (rows.size() == fetchSize) // If fetchSize is 0 then unlimited > break; > > The cursor is cached and reused there, so is this task is executed twice > for > the same result set, it will not execute the query from scratch, but will > get the existing cursor and start iteration from where it finished on the > first invocation. > > I'm not completely sure that I correctly understand what you mean by > streaming here, but paging is definitely in place and that's how it works > now. > > -Val > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Fetching-large-number-of-records-tp9267p9373.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > --001a11474ba494d5b40542b887ae Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Val,

Thanks for clarification. I und= erstand something and i will give a try.

Thanks.

On 2 De= cember 2016 at 23:17, vkulichenko <valentin.kulichenko@gmail.c= om> wrote:
Anil,

The JdbcQueryTask is executed each time the next page is needed. And the number of rows returned by the task is limited by fetchSize:

=C2=A0 =C2=A0 if (rows.size() =3D=3D fetchSize) // If fetchSize is 0 then u= nlimited
=C2=A0 =C2=A0 =C2=A0 =C2=A0 break;

The cursor is cached and reused there, so is this task is executed twice fo= r
the same result set, it will not execute the query from scratch, but will get the existing cursor and start iteration from where it finished on the first invocation.

I'm not completely sure that I correctly understand what you mean by streaming here, but paging is definitely in place and that's how it wor= ks
now.

-Val



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.c= om/Fetching-large-number-of-records-tp9267p9373.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

--001a11474ba494d5b40542b887ae--