Return-Path: X-Original-To: apmail-apex-users-archive@minotaur.apache.org Delivered-To: apmail-apex-users-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2A9ED19D33 for ; Sun, 17 Apr 2016 03:24:23 +0000 (UTC) Received: (qmail 22954 invoked by uid 500); 17 Apr 2016 03:24:22 -0000 Delivered-To: apmail-apex-users-archive@apex.apache.org Received: (qmail 22897 invoked by uid 500); 17 Apr 2016 03:24:22 -0000 Mailing-List: contact users-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@apex.incubator.apache.org Delivered-To: mailing list users@apex.incubator.apache.org Received: (qmail 22887 invoked by uid 99); 17 Apr 2016 03:24:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Apr 2016 03:24:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 21BF21A0443 for ; Sun, 17 Apr 2016 03:24:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.279 X-Spam-Level: * X-Spam-Status: No, score=1.279 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=datatorrent-com.20150623.gappssmtp.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id rt-iVocRYaFl for ; Sun, 17 Apr 2016 03:24:20 +0000 (UTC) Received: from mail-pa0-f41.google.com (mail-pa0-f41.google.com [209.85.220.41]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id A4D705F1EC for ; Sun, 17 Apr 2016 03:24:19 +0000 (UTC) Received: by mail-pa0-f41.google.com with SMTP id er2so39023184pad.3 for ; Sat, 16 Apr 2016 20:24:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=datatorrent-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=aCF28Ro98Lft94phAtJARWbW2+PjCEpMSvS/5RszLYw=; b=UEzv5AexH4tubOE8T64apDSSBM9Oav+OyuIDqoCBi0YkzJWF0s/7ShPInwTeePrG1m /39BuWZLmxt9Aw99PR6BF1DAuiDSB/rrWsvU9Xteei6au5RNQTrOvaYvbNyp9Oa6Yefw WWUdBuVSA0r/H15jL7OQhjoiaAjNNPIRbSrdNUkojfDkunoCn0iBji5NqtfjTYosrehF Vf7Jz/VAPcoEHCbCWnDUZo7iDBeDMTA8Bl+19CDSDS2SPQJwso50iMISWKmdV5qmRItv A92pNJDAK5FMJ28oSjHCvZxP9lcBeH3SrpHiIBxQQJIIILJo96VqBH7+iglzBJ/hxCud UeBA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=aCF28Ro98Lft94phAtJARWbW2+PjCEpMSvS/5RszLYw=; b=W535ptKqNbdVEZDpylj6cxjFzmsU4NtXpQDozPy1bg5VPC9KJX9zuMeMS/oweUv4sy qOxHFXFqXhX8F7DM3JOAUXt3vo8yLACsFldMzBWaZ8lu5suaCb6F7W8SV/r1794wRui1 F1jflmkcyvTRg1mX1yfTSBXQC7VdBdCW4rh/Sdt6spGj1xZN4h5NNCz/ffniAwIAMgzg /pdmjF8MNjmOc2qlOG+elmw2ihGJp6nuBTEilPh8PrUjh5HL9isc3EreKMFd9qsAwe8J z1op7HZFGlNPIKka6D8u3URhWk/tirIGC7TunV7Jxlk2sFZ69B45Pcp+Hj4jyb1CnQBN +zOg== X-Gm-Message-State: AOPr4FWgy53vJbNVLd28/azPLl4vPvkIqsIBdZFh/iUF7FG8BY4b004fxXMpjKcROY4d3/mpKKI3CJAZaLgEP0hZ MIME-Version: 1.0 X-Received: by 10.66.136.41 with SMTP id px9mr40378691pab.80.1460863452890; Sat, 16 Apr 2016 20:24:12 -0700 (PDT) Received: by 10.66.250.130 with HTTP; Sat, 16 Apr 2016 20:24:12 -0700 (PDT) In-Reply-To: References: Date: Sat, 16 Apr 2016 20:24:12 -0700 Message-ID: Subject: Re: Apex engine and malhar maven versions for Kafka 0.9 version operator From: Munagala Ramanath To: users@apex.incubator.apache.org Content-Type: multipart/alternative; boundary=001a1133096e2ce44f0530a5c776 --001a1133096e2ce44f0530a5c776 Content-Type: text/plain; charset=UTF-8 Ananth, Could you make your pom.xml accessible somewhere ? Ram On Sat, Apr 16, 2016 at 3:30 PM, Ananth Gundabattula < agundabattula@gmail.com> wrote: > Hello all, > > I would like to run a unit test code using the new Kafka Operator that > supports the 0.9 version protocol. > > In this process, I included the malhar-kafka library version ( > 3.3.1-incubating ) and am using the apex-engine ( version 3.3.0 ) with > as test/provided. > > The compilation works fine but my unit tests fail to run properly with " > java.lang.ClassNotFoundException: com.datatorrent.lib.util.KryoCloneUtils" > exception. > > > What is the recommended way to run a unit test which uses Kafka 0.9 > operator integrated with the Apex engine ? I am assuming that the > malhar-contrib library kafka operator is not 0.9 compliant .. > > The unit test code is like this : > > The class CassandraEventDetailsStreamingApp extends the > AbstractKafkaInputOperator in the below snippet of code. > > The exception arises in the method lma.getController(); > > @Test > public void testApplication() throws IOException, Exception { > try { > LocalMode lma = LocalMode.newInstance(); > Configuration conf = new Configuration(false); > conf.addResource(this.getClass().getResourceAsStream("/dag-test-props.xml")); > lma.prepareDAG(new CassandraEventDetailsStreamingApp(), conf); > LocalMode.Controller lc = lma.getController(); > lc.run(); > } catch (ConstraintViolationException e) { > Assert.fail("constraint violations: " + e.getConstraintViolations()); > } > } > > > > Regards, > Ananth > --001a1133096e2ce44f0530a5c776 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Ananth,

Could you make your pom.xml acc= essible somewhere ?

Ram

On Sat, Apr 16, 2016 at 3:30 PM,= Ananth Gundabattula <agundabattula@gmail.com> wrote:<= br>
Hello all,

I would like to run a unit test code using th= e new Kafka Operator that supports the 0.9 version protocol.

= In this process, I included the malhar-kafka library version ( 3.3.1-incuba= ting ) and am using the apex-engine ( version 3.3.0 ) with <scope> as= test/provided.

The compilation works fine but my unit tests = fail to run properly with " java.lang.ClassNotFoundException: com.data= torrent.lib.util.KryoCloneUtils"=C2=A0 exception.


Wh= at is the recommended way to run a unit test which uses Kafka 0.9 operator = integrated with the Apex engine ? I am assuming that the malhar-contrib lib= rary kafka operator is not 0.9 compliant ..

The unit tes= t code is like this :

The class CassandraEventDetailsStr= eamingApp extends the AbstractKafkaInputOperator in the below snippet of co= de.

The exception arises in the method lma.getController= ();
@Test
pu=
blic void testApplication() throws IOException, Exception {
    try {
        LocalMode lma =3D LocalMode.=
newInstance();
        =
Configuration conf =3D new Configuration(false);
        conf.addResource(this.getClass().getResourceAsStream("/dag-test-props.xml"));
        lma.prepareDAG(new CassandraE=
ventDetailsStreamingApp(), con=
f);
        LocalMode.Controller lc =3D lma.getController=
();
        lc.run();
    } catch (ConstraintViolationException e) {
        Assert.fail(&q=
uot;constraint violations: " + e.getConstraintViolations());
    }
}
=


Regards,
Ananth

--001a1133096e2ce44f0530a5c776--