Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 200B3101E0 for ; Mon, 3 Feb 2014 22:55:27 +0000 (UTC) Received: (qmail 90042 invoked by uid 500); 3 Feb 2014 22:55:26 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 90007 invoked by uid 500); 3 Feb 2014 22:55:26 -0000 Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.incubator.apache.org Delivered-To: mailing list user@storm.incubator.apache.org Received: (qmail 89998 invoked by uid 99); 3 Feb 2014 22:55:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 22:55:25 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ptgoetz@gmail.com designates 209.85.216.175 as permitted sender) Received: from [209.85.216.175] (HELO mail-qc0-f175.google.com) (209.85.216.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 22:55:21 +0000 Received: by mail-qc0-f175.google.com with SMTP id x13so12201853qcv.6 for ; Mon, 03 Feb 2014 14:55:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:message-id:mime-version:subject:date:references :to:in-reply-to; bh=orewDaPjgi9/Nb58+RCafQ7305O0i4kCvYJWR+WMnts=; b=wKfSSMG7BLa085LLtVtgq1RP4kBBTeADd0JI+/ol0avmo4cBGfsdOKi21TovNruT4e dfrjIGpDtPS9k1a8dlaEdNeDcaT+hAuPP7EGIF1hLjXT9Iw6bExJ94lB4J15srIF23Ez LO+4hyPb33B9Ye4jryXs22im259Du6ZTiwvXF1JdmomeCgCxNwHo0kPP3+itogeoP8C+ FjNEuJ5XABO68sBaaqNWcGs3gkeGZVxLQShtNDHxkcums4SLKCtkbMASpQlCShoB9fMW 0JcqnAm+6nCNnBv+cYEuE7exoyxPxlX5fbJmsEhyyyuj+CsjLgnffqKbBDU5fzLIqDya kBUQ== X-Received: by 10.224.79.133 with SMTP id p5mr61343230qak.56.1391468100446; Mon, 03 Feb 2014 14:55:00 -0800 (PST) Received: from thidwick.local (pool-173-59-54-41.phlapa.fios.verizon.net. [173.59.54.41]) by mx.google.com with ESMTPSA id k107sm29365780qgk.5.2014.02.03.14.54.52 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 03 Feb 2014 14:54:59 -0800 (PST) From: "P. Taylor Goetz" Content-Type: multipart/signed; boundary="Apple-Mail=_58357018-0372-4A19-BABC-FD41E5A05C44"; protocol="application/pgp-signature"; micalg=pgp-sha512 Message-Id: <9BDA7B8C-4417-4D06-8CDA-56CAB2EBB8E7@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 7.1 \(1827\)) Subject: Re: trident simplest aggregator into cassandra Date: Mon, 3 Feb 2014 17:54:40 -0500 References: <751d1546c2d34fdf8402f5c3d9897bc7@CO2PR07MB522.namprd07.prod.outlook.com> <6C8D8D38-B4ED-45CC-9A37-6202D98B78DF@gmail.com> <8a23eb1f5f1c4da3b9984669a3e32f80@CO2PR07MB522.namprd07.prod.outlook.com> To: user@storm.incubator.apache.org In-Reply-To: <8a23eb1f5f1c4da3b9984669a3e32f80@CO2PR07MB522.namprd07.prod.outlook.com> X-Mailer: Apple Mail (2.1827) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_58357018-0372-4A19-BABC-FD41E5A05C44 Content-Type: multipart/alternative; boundary="Apple-Mail=_45D69A79-C7E0-4EB9-993A-5816C5C3756A" --Apple-Mail=_45D69A79-C7E0-4EB9-993A-5816C5C3756A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 The storm-cassandra project = (https://github.com/hmsonline/storm-cassandra) is actively maintained = (DISCLAIMER: I=92m the original author), so I would give that one a try. = It=92s also aligned with the latest version of storm.=20 Also, which version of storm are you using? - Taylor On Feb 3, 2014, at 5:34 PM, Adrian Mocanu = wrote: > It=92s from trident.cassandra > libraryDependencies +=3D "trident-cassandra" %"trident-cassandra" % = "0.0.1-wip2" > =20 > but I modified the file and removed an IMetrics parameter (it seems I = have 2 interfaces for it in my code so during runtime it would think it = was the other interface which did not have that param and crashed) = Anyhow, I saw that there is another version of CassandraState in = hmsonline project (libraryDependencies +=3D "com.hmsonline" % = "storm-cassandra" % "0.4.0-rc4") which is very different. I did not use = that one =96 I thought that was the older version. > =20 > Thanks > A > From: P. Taylor Goetz [mailto:ptgoetz@gmail.com]=20 > Sent: February-03-14 5:21 PM > To: user@storm.incubator.apache.org > Subject: Re: trident simplest aggregator into cassandra > =20 > Which project did the CassandraState implementation come from? > =20 > =20 > On Feb 3, 2014, at 5:09 PM, Adrian Mocanu = wrote: >=20 >=20 > Hi > I'm using Trident to perform some aggregations and store the results = into cassandra. > =20 > I've looked at IBackingMap and specifically at some tutorials on = trident site and I've tried using CassandraState which I found online in = some repository. After creating what I thought were column family and = keys corresponding to the code I still cannot figure out how to run the = sample topology and not crash due to some Cassandra schema error = (InvalidRequestException(why:Invalid cell for CQL3 table state. The CQL3 = column component (over) does not correspond to a defined CQL3 column). > =20 > Here is the sample code I use: > =20 > val cassandraStateFactory:StateFactory =3D = chat.CassandraState.transactional("10.10.6.80") > =20 > val spout =3D new FixedBatchSpout(new Fields("sentence"), 3, > new Values("the cow jumped over the moon"), > new Values("the man went to the store and bought some candy"), > new Values("four score and seven years ago"), > new Values("how many apples can you eat")) > spout.setCycle(true) > =20 > val wordCounts :TridentState=3D tridentBuilder.newStream("spout1", = spout) > .each(new Fields("sentence"), new Split(), new Fields("word")) > .groupBy(new Fields("word")) > .persistentAggregate(cassandraStateFactory, new Count(), new = Fields("count")) > .parallelismHint(6) > =20 > val cluster =3D new LocalCluster(); > val config =3D new Config(); > config.setMaxSpoutPending(100); > config.setMaxSpoutPending(25); > cluster.submitTopology("test", config, tridentBuilder.build()); > =20 > =20 > What is the schema needed to run this example (it also uses = CassandraState)? > =20 > thanks > A --Apple-Mail=_45D69A79-C7E0-4EB9-993A-5816C5C3756A Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252
The storm-cassandra project (https://github.com/h= msonline/storm-cassandra) is actively maintained (DISCLAIMER: I=92m = the original author), so I would give that one a try. It=92s also = aligned with the latest version of = storm. 

Also, which version of storm are = you using?

- = Taylor


On Feb 3, 2014, at 5:34 PM, = Adrian Mocanu <amocanu@verticalscope.com>= ; wrote:

It=92s from = trident.cassandra
libraryDependencies +=3D "trident-cassandra" = %"trident-cassandra" % "0.0.1-wip2"
 
but I modified the file = and removed an IMetrics parameter (it seems I have 2 interfaces for it = in my code so during runtime it would think it was the other interface = which did not have that param and crashed) Anyhow, I saw that there is = another version of CassandraState in hmsonline project = (libraryDependencies +=3D "com.hmsonline" % "storm-cassandra" % = "0.4.0-rc4") which is very different. I did not use that one =96 I = thought that was the older version.
 
Thanks
A
From: P. Taylor Goetz [mailto:ptgoetz@gmail.com] 
Sent: February-03-14 5:21 = PM
To: user@storm.incubator.apach= e.org
Subject: Re: trident simplest = aggregator into cassandra
 
Which = project did the CassandraState implementation come = from?
 
 
On = Feb 3, 2014, at 5:09 PM, Adrian Mocanu <amocanu@verticalscope.com> = wrote:


Hi
I'm using Trident to perform some aggregations and store = the results into cassandra.
 
I've looked at IBackingMap and specifically at = some tutorials on trident site and I've tried using CassandraState which = I found online in some repository. After creating what I thought were = column family and keys corresponding to the code I still cannot figure = out how to run the sample topology and not crash due to some Cassandra = schema error (InvalidRequestException(why:Invalid cell for CQL3 table = state. The CQL3 column component (over) does not correspond to a defined = CQL3 column).
 
Here is the sample code I = use:
 
  val cassandraStateFactory:StateFactory =3D = chat.CassandraState.transactional("10.10.6.80")
 
    val spout =3D new = FixedBatchSpout(new Fields("sentence"), = 3,
      new Values("the cow jumped = over the moon"),
      new Values("the man went to = the store and bought some = candy"),
      new Values("four score and = seven years ago"),
      new Values("how many apples = can you eat"))
    = spout.setCycle(true)
 
    val wordCounts :TridentState=3D = tridentBuilder.newStream("spout1", = spout)
      .each(new = Fields("sentence"), new Split(), new = Fields("word"))
      .groupBy(new = Fields("word"))
      = .persistentAggregate(cassandraStateFactory, new Count(), new = Fields("count"))
      = .parallelismHint(6)
 
    val cluster =3D new = LocalCluster();
    val config =3D new = Config();
    = config.setMaxSpoutPending(100);
    = config.setMaxSpoutPending(25);
    cluster.submitTopology("test", = config, tridentBuilder.build());
 
 
What is the schema needed to run this example (it = also uses CassandraState)?
 
thanks
A

= --Apple-Mail=_45D69A79-C7E0-4EB9-993A-5816C5C3756A-- --Apple-Mail=_58357018-0372-4A19-BABC-FD41E5A05C44 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJS8B4wAAoJEI3gOWLoC4/93vkIAI0YBAPLoJGII9IO2bTO//9Z ga/ktI2XE9OGLbwfQTLOfdYgnEYYkqbOGL8DG5RoBMLUKUPNqZ91MCTeQDNEeMkJ AYIKPGCthSA2vyBZBmj4ran+M1AmJ+I58Wd9YlBsYYqy6DGhUipAzsRVqqyKVP4M hMSHdLKLbEEC2l5ehA+89HnW7SgH//K8JVe5LXYijvWkWtNNOd5E5cNiHfB+pvqQ wi5s00lix7JAZ6WJYG4vqWeziSbJGR3PvHeHey181W4OdGPHr9+M+lhduUm16ON/ onNhfHiaU4uhny/FeqgWg8ljEA3f1+Hh7F5Y6uKwOxgkSQFRqKxS8pNbK8V9W+M= =+ReM -----END PGP SIGNATURE----- --Apple-Mail=_58357018-0372-4A19-BABC-FD41E5A05C44--