Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D2668200B36 for ; Wed, 6 Jul 2016 17:52:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D0FF3160A64; Wed, 6 Jul 2016 15:52:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F2139160A55 for ; Wed, 6 Jul 2016 17:52:15 +0200 (CEST) Received: (qmail 23856 invoked by uid 500); 6 Jul 2016 15:52:15 -0000 Mailing-List: contact users-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@apex.apache.org Delivered-To: mailing list users@apex.apache.org Received: (qmail 23846 invoked by uid 99); 6 Jul 2016 15:52:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Jul 2016 15:52:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B2A551A603F for ; Wed, 6 Jul 2016 15:52:14 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.299 X-Spam-Level: * X-Spam-Status: No, score=1.299 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=datatorrent-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id JI7REz0xMQGD for ; Wed, 6 Jul 2016 15:52:10 +0000 (UTC) Received: from mail-qt0-f173.google.com (mail-qt0-f173.google.com [209.85.216.173]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 25A265F257 for ; Wed, 6 Jul 2016 15:52:10 +0000 (UTC) Received: by mail-qt0-f173.google.com with SMTP id w59so118637595qtd.3 for ; Wed, 06 Jul 2016 08:52:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=datatorrent-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=im7KTQLx6czM9g7HDLZu8+1JAbQSOJceBvYWO6x/n90=; b=tnnW+73ekww89RZST8G190lSIRDhSk45LT4aSEU8gOh+Ju983hpRUaH/oKDW94cnWI p0ScZEHp589s31d+K75dtsqRpdBzA+qFhJEso1RKur1HwbcCPJRM1GgApS/H43SLI/s2 934IVhp6RHKegrsg3bvwF6Dcc5wsW9VjW/O15M6ckUImVxiBicn3l4+qAcnXI2ZyCpph 2KRDnyLx0O8SF9kHVJRBB0x6lha9VzDsiANGF4xGSzjglOJxcMG0rjT+AuPNuOsi/MJo 6nXqcDzYhXous00Mq5R1HjBTlgL7nF/lUFZKWiItrzk8dKzIi6nBeWMvbWmFjpw88KO5 bohw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=im7KTQLx6czM9g7HDLZu8+1JAbQSOJceBvYWO6x/n90=; b=E7LhNYuYEfndDLJ5+kZu2eVgqP/qpREplsRpunLKkJ9UsoiqCWVQ66zQf3ebfrbcAa rO/v3Af+5Pm3qKlgiPgTtdIY/IIFZwZ2OH76akfY5Q5b7KXKNGX47uUB1W4kedqjTojp ZJEhGJTKaCGn/6OwP9NvoFOjpNfdxPGqxmKW5+BkLTUDjoZXCaDHcVOoHkTKIBJ9JudC uMz/clqPueYup8Hut2EN4Sjaa8rzSXZbAAC/ISWxxlQsfo9P7PmY4znWA2yeweSwqjsj yDcC93A4rsZTc/S9ssMuBPJDZf7jVphMbO+h9uepFtHb02XYFH1yjHP942sZ21kIk5zf kysw== X-Gm-Message-State: ALyK8tLeYeiBzVTZKN86Oy7ksBzE4vWb5T2RQw0RoFEccsYwuXc8qLP1cO2QlnMl3Jb7wQDEqYb83Docxb6nOksS X-Received: by 10.200.38.135 with SMTP id 7mr36411618qto.72.1467820329026; Wed, 06 Jul 2016 08:52:09 -0700 (PDT) MIME-Version: 1.0 References: <1878E669-FA6B-41D0-AE3E-DAF59CF8C03E@target.com> <63A090E5-B3FB-4E04-AA8B-7FDC490EE296@target.com> In-Reply-To: <63A090E5-B3FB-4E04-AA8B-7FDC490EE296@target.com> From: Sandesh Hegde Date: Wed, 06 Jul 2016 15:51:59 +0000 Message-ID: Subject: Re: sticky partitioning To: "users@apex.apache.org" Content-Type: multipart/alternative; boundary=001a114038d24e73830536f98d59 archived-at: Wed, 06 Jul 2016 15:52:17 -0000 --001a114038d24e73830536f98d59 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Default implementation uses the hashcode of the tuple to select the partition, so it is sticky. If you want to do more than that, take look here https://github.com/DataTorrent/examples/tree/master/tutorials/partitio= n On Wed, Jul 6, 2016 at 8:34 AM Raja.Aravapalli wrote: > > Hi Sandesh, > > Thanks for the response. > > What I am looking for is StickKey partitioning!! > > Something like=E2=80=A6.. Records with same key A goes into same instance= of n > operator !!* [ Sticky Partition vs Round Robin @ * > http://docs.datatorrent.com/application_development/#sticky-partition-vs-= round-robin > *] * > > Can you pls share some reference code link ? > > > Regards, > Raja. > > From: Sandesh Hegde > Reply-To: "users@apex.apache.org" > Date: Wednesday, July 6, 2016 at 10:06 AM > To: "users@apex.apache.org" > Subject: Re: sticky partitioning > > Default stateless partitioning is the one you want. > > Here is the Sample code, which uses that. > > > https://github.com/DataTorrent/streaming-benchmarks/blob/master/apex-benc= hmarks/src/main/java/apex/benchmark/ApplicationWithGenerator.java > > > > > On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli > wrote: > >> >> Hi, >> >> Can some one please point me to a sample code/link that does uses the >> *stickykey* partitioning in Apex. >> >> I couldn=E2=80=99t locate any.. >> >> Thanks a lot. >> >> >> Regards, >> Raja. >> > --001a114038d24e73830536f98d59 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Default implementation uses the hashcode of the tuple to s= elect the partition, so it is sticky. If you want to do more than that, tak= e look here=C2=A0https://github.com/DataTorrent/examples/tree/mast= er/tutorials/partition

On Wed, Jul 6, 2016 at 8:34 AM Raja.Aravapalli <Raja.Aravapalli@target.com> wrote:

Hi Sandesh,=C2=A0

Thanks for the response.=C2=A0

What I am looking for is StickKey partitionin= g!!

Something like=E2=80=A6.. Records with same k= ey A goes into same instance of n operator !! [=C2=A0Sticky Partition vs Round Robin @=C2=A0http://docs.datatorrent.com/application_development/#sticky-partit= ion-vs-round-robin= ]=C2=A0

Can you pls share some reference code link ?<= /div>


Regards,
Raja.

From: Sandesh Hegde <sandesh@datatorrent.com>
Reply-To: "users@apex.apache.org" <= ;users@apex.apac= he.org>
Date: Wednesday, July 6, 2016 at 10= :06 AM
To: "users@apex.apache.org" <users@apex.apache.org= >
Subject: Re: sticky partitioning

Default stateless partitioning is the one you want.

Here is the Sample code, which uses that.





On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli <Raja.Aravapalli@ta= rget.com> wrote:

Hi,

Can some one please point me to a sample code/link that does uses the = stickykey partitioning in Apex.=C2=A0

I couldn=E2=80=99t locate any..

Thanks a lot.


Regards,
Raja.
--001a114038d24e73830536f98d59--