Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8B225200B73 for ; Mon, 29 Aug 2016 10:39:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 89B19160AB8; Mon, 29 Aug 2016 08:39:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5D286160AA7 for ; Mon, 29 Aug 2016 10:39:15 +0200 (CEST) Received: (qmail 21935 invoked by uid 500); 29 Aug 2016 08:39:14 -0000 Mailing-List: contact users-help@apex.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@apex.apache.org Delivered-To: mailing list users@apex.apache.org Received: (qmail 21926 invoked by uid 99); 29 Aug 2016 08:39:14 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Aug 2016 08:39:14 +0000 Received: from mail-pa0-f43.google.com (mail-pa0-f43.google.com [209.85.220.43]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 57EA11A0247 for ; Mon, 29 Aug 2016 08:39:14 +0000 (UTC) Received: by mail-pa0-f43.google.com with SMTP id fi15so47527843pac.1 for ; Mon, 29 Aug 2016 01:39:14 -0700 (PDT) X-Gm-Message-State: AE9vXwNhywa/7bZ6rLH3usZ9R2/LBRxls2lP8/1w48BuGOoX9XNINpIg3e1z6/BCPOUOeWYnZwwX6uEmj2Vgokp0 X-Received: by 10.66.148.202 with SMTP id tu10mr30359186pab.52.1472459953700; Mon, 29 Aug 2016 01:39:13 -0700 (PDT) MIME-Version: 1.0 Received: by 10.66.74.100 with HTTP; Mon, 29 Aug 2016 01:39:13 -0700 (PDT) In-Reply-To: References: From: Priyanka Gugale Date: Mon, 29 Aug 2016 14:09:13 +0530 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Connecting multiple operators To: users@apex.apache.org Content-Type: multipart/alternative; boundary=047d7b677f2c7c9a19053b31cc9e archived-at: Mon, 29 Aug 2016 08:39:16 -0000 --047d7b677f2c7c9a19053b31cc9e Content-Type: text/plain; charset=UTF-8 Hitesh, Can you please share code of your MeanOperator and StandardDeviationOperator. Also please share the application logs. After shutting down application you can run "yan logs -applicationId to collect logs. -Priyanka On Mon, Aug 29, 2016 at 10:39 AM, Hitesh Goyal wrote: > Hi team, > > > > I am trying to process some data using Operators. > > > > @SuppressWarnings("unchecked") > > @Override > > *public* *void* populateDAG(DAG dag, Configuration conf) { > > System.*setProperty*("viewmode", "production"); > > CouchBasePOJOInputOperator inputOperator = dag.addOperator(" > inputOperator", CouchBasePOJOInputOperator.*class*); > > inputOperator.setStore(*new* CouchBaseStore()); > > MedOperator med = dag.addOperator("median", MedOperator. > *class*); > > MeanOperator mean=dag.addOperator("mean", MeanOperator. > *class*); > > StandardDeviationOperator sdo=dag.addOperator("sdo", > StandardDeviationOperator.*class*); > > ConsoleOutputOperator cons = dag.addOperator("cons", *new* > ConsoleOutputOperator()); > > ConsoleOutputOperator cons1 = dag.addOperator("cons1", *new* > ConsoleOutputOperator()); > > ConsoleOutputOperator cons2 = dag.addOperator("cons2", *new* > ConsoleOutputOperator()); > > dag.addStream("inputFormatter", inputOperator.outputPort, > med.data,mean.meandata,sdo.meandata); > > dag.addStream("cons", med.median, cons.input).setLocality( > Locality.*THREAD_LOCAL*); > > dag.addStream("cons1", mean.mean, cons1.input).setLocality( > Locality.*THREAD_LOCAL*); > > dag.addStream("cons2", sdo.deviation, cons2.input > ).setLocality(Locality.*THREAD_LOCAL*); > > } > > There is no error in the code but when I launch this application in Data > Torrent, the status of operators remains pending instead of Running/Active. > Physical DAG view is clearly showing right connection of one stream to > another. > > > > > > Regards, > > *Hitesh Goyal* > > Simpli5d Technologies > > Cont No.: 9599803307 > > > --047d7b677f2c7c9a19053b31cc9e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hitesh,

Can you please share code of yo= ur MeanOperator and=C2=A0StandardDeviationOperator.=C2=A0
<= span style=3D"color:rgb(0,0,0);font-family:Consolas;font-size:13.3333px">Al= so please=C2=A0share the applicatio= n logs. After shutting down application you can run "yan logs -applica= tionId <appId> to collect logs.

-Priyan= ka

On Mon, Aug 29, 2016 at 10:39 AM, Hitesh Goyal <hitesh.goyal= @nlpcaptcha.com> wrote:

Hi team,

=C2=A0

I am trying to process some data using Operators.=

=C2=A0

@Suppre= ssWarnings("unchecked")

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 @Override

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 public void populateDAG(DAG = dag, Configuration = conf) {

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Syste= m.setProperty("viewmode", = "production");

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Couch= BasePOJOInputOperator = inputOperator =3D = dag.addOperator("inputOperator", CouchBasePOJOInputOperator.class);

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inputOp= erator.setStore(new CouchBaseStore());

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 MedOp= erator = med =3D = dag.addOperator("median", MedOperator.class);

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 MeanO= perator = mean=3Ddag.addOperator("mean", MeanOperator.class);

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Stand= ardDeviationOperator = sdo=3Ddag.addOperator("sdo", StandardDeviationOperator.class);

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Conso= leOutputOperator = cons =3D = dag.addOperator("cons", new ConsoleOutputOperator());

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Conso= leOutputOperator = cons1 =3D = dag.addOperator("cons1", new ConsoleOutputOperator());

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Conso= leOutputOperator = cons2 =3D = dag.addOperator("cons2", new ConsoleOutputOperator());

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 dag.addSt= ream("inputFormatter", = inputOperator.outputPort, = med.data,mean.meandata,sdo.meandata);

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 dag.addStream("cons", = med.median, = cons.input).setLocality(Locality.THREAD_LOCAL);<= u>

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 dag.addStream("cons1", = mean.mean, = cons1.input).setLocality(Locality.THREAD_LOCAL);=

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 dag.addStream("cons2", = sdo.deviation, = cons2.input).setLocality(Locality.THREAD_LOCAL);=

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 }

=C2=A0 There is no error in the code but when I laun= ch this application in Data Torrent, the status of operators remains pendin= g instead of Running/Active. Physical DAG view is clearly showing right connection of one stream to another.=C2=A0

=C2=A0

=C2=A0

Regards,

Hitesh Goyal

Simpli5d Technologies

Cont No.: 9599803307

=C2=A0


--047d7b677f2c7c9a19053b31cc9e--