Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3EFFE10EE6 for ; Thu, 2 Jan 2014 03:43:53 +0000 (UTC) Received: (qmail 44762 invoked by uid 500); 2 Jan 2014 03:43:49 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 44678 invoked by uid 500); 2 Jan 2014 03:43:46 -0000 Mailing-List: contact user-help@storm.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.incubator.apache.org Delivered-To: mailing list user@storm.incubator.apache.org Received: (qmail 44663 invoked by uid 99); 2 Jan 2014 03:43:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jan 2014 03:43:44 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ncleung@gmail.com designates 209.85.223.178 as permitted sender) Received: from [209.85.223.178] (HELO mail-ie0-f178.google.com) (209.85.223.178) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Jan 2014 03:43:38 +0000 Received: by mail-ie0-f178.google.com with SMTP id lx4so14266582iec.37 for ; Wed, 01 Jan 2014 19:43:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=3M6TZ1naFy/YJ8YltBajAkdEphl3FaCiobGxfWpONaw=; b=aQB5Czp+mhHB6FJ88+BR8+wZoXTDNz8bZyOkH0Pm1Py+XKqSuJH/HMm1Gw3tlF++kg IAKWl/+pUFYMF4BmCWUS4HA+gi7GG7JvEFhSfS4arCNI4vUKo0NlBCJk3PrUbFTBhOn1 SHmLTGWYm3/zYMKpk+jhRsZuMaFWx3eynxxImsjalFN2Wmp+vVAExvcKbSqpy92ms+a1 rI9ta4UgKmCyp69AuAFRmSjKsn0N5Z/zYSGLcwh7zpTT5yMDrmUUaD1ZD/ekYCumPUGI sMP1kUc0loPOaMsttuooUV9oThms+eBm5F0YW07gIwc6uob8vKzGXSsQa7Il1XkYb197 urBQ== MIME-Version: 1.0 X-Received: by 10.43.137.71 with SMTP id in7mr990icc.97.1388634197697; Wed, 01 Jan 2014 19:43:17 -0800 (PST) Received: by 10.64.227.197 with HTTP; Wed, 1 Jan 2014 19:43:17 -0800 (PST) Received: by 10.64.227.197 with HTTP; Wed, 1 Jan 2014 19:43:17 -0800 (PST) In-Reply-To: References: Date: Wed, 1 Jan 2014 22:43:17 -0500 Message-ID: Subject: Re: Error in submitting Topology From: Nathan Leung To: user Content-Type: multipart/alternative; boundary=001a11c2542813f42004eef49862 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2542813f42004eef49862 Content-Type: text/plain; charset=ISO-8859-1 No, maven can manage the entire project life cycle including compilation and packaging into a jar file. On Jan 1, 2014 7:01 PM, "researcher cs" wrote: > do you mean that compiling WordCountTopology class using Eclipse or > netbeans and then trying to implement storm jar ? > > > On Thu, Jan 2, 2014 at 1:54 AM, Nathan Leung wrote: > >> It looks like for some reason the java file got included as a text file, >> not compiled as a class file. My recommendation is, since you do not seem >> to be able to diagnose that yourself, you should familiarize yourself with >> the toolchain, including jdk tools and maven. Then you will be able to >> debug this problem yourself. :) >> >> >> On Wed, Jan 1, 2014 at 5:52 PM, researcher cs wrote: >> >>> i really wonder why storm jar can't find or load main class of >>> wordcounttopology ..? >>> >>> >>> On Thu, Jan 2, 2014 at 12:38 AM, researcher cs < >>> prog.researcher@gmail.com> wrote: >>> >>>> Nathan , i tried searching WordCountTopology in storm-starter >>>> wrote this command >>>> user@ubuntu:~/Storm/storm-0.8.2$ jar -tf storm-starter.jar >>>> and got >>>> storm-starter/src/jvm/storm/starter/WordCountTopology.java >>>> >>>> >>>> On Tue, Dec 31, 2013 at 10:59 PM, Nathan Leung wrote: >>>> >>>>> Yes >>>>> On Dec 31, 2013 2:58 PM, "researcher cs" >>>>> wrote: >>>>> >>>>>> Nathan , Do you mean by jar -tf for searching WordCountTopology in >>>>>> storm-starter.jar or what ... ? >>>>>> >>>>>> >>>>>> On Tue, Dec 31, 2013 at 9:24 PM, Nathan Leung wrote: >>>>>> >>>>>>> If the jar file is in fact in the location you expect it you can >>>>>>> also jar -tf on the file and search for the WordCountTopology. >>>>>>> On Dec 31, 2013 1:37 PM, "researcher cs" >>>>>>> wrote: >>>>>>> >>>>>>>> Yes,Nathan I've storm-starter.jar and installed maven and run >>>>>>>> topology successfully >>>>>>>> >>>>>>>> >>>>>>>> On Tue, Dec 31, 2013 at 3:06 PM, Nathan Leung wrote: >>>>>>>> >>>>>>>>> Do you have a file storm-starter.jar? This doesn't match the >>>>>>>>> snapshot naming that maven created for the "with dependencies" jar file. >>>>>>>>> Also did you do mvn install? >>>>>>>>> >>>>>>>>> -Nathan >>>>>>>>> On Dec 31, 2013 12:55 AM, "researcher cs" < >>>>>>>>> prog.researcher@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Thanks Abhishek for replying >>>>>>>>>> Steps >>>>>>>>>> 1- After installed storm .. i downloaded storm-starter to run it >>>>>>>>>> on storm >>>>>>>>>> 2- running WordCountTopology using maven "build successfully" >>>>>>>>>> 3- trying to submit a topology on storm ui . using storm jar >>>>>>>>>> 4- i used storm jar SNAPSHOT with dependencies and worked well .. >>>>>>>>>> 5- trying to use storm jar user@ubuntu:~/Storm/storm$ bin/storm >>>>>>>>>> jar storm-starter.jar storm.starter.WordCountTopology wordcount but it >>>>>>>>>> didn't work got this error "cannot find or load main class of >>>>>>>>>> WordCountTopology" >>>>>>>>>> >>>>>>>>>> but i want to tell you something i guessed that it's the reason >>>>>>>>>> when i imported package of storm starter in Eclipse to run code >>>>>>>>>> of it .. i found error it's backtype package not defined !! >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Dec 31, 2013 at 6:44 AM, Abhishek Bhattacharjee < >>>>>>>>>> abhishek.bhattacharjee11@gmail.com> wrote: >>>>>>>>>> >>>>>>>>>>> What are you doing exactly could you send the steps you are >>>>>>>>>>> following ? If you are having problems with mvn use lein. >>>>>>>>>>> Send the logs of what you are doing that will help us understand >>>>>>>>>>> why exactly you are getting the error. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tue, Dec 31, 2013 at 4:15 AM, researcher cs < >>>>>>>>>>> prog.researcher@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Thanks Aniket >>>>>>>>>>>> >>>>>>>>>>>> problem still persist after mvn clean install >>>>>>>>>>>> >>>>>>>>>>>> for your question do you mean that >>>>>>>>>>>> /home/usr/Storm/storm/storm-starter/src/jvm/storm/starter/ >>>>>>>>>>>> WordCountTopology.java >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Dec 30, 2013 at 10:25 AM, Aniket Alhat < >>>>>>>>>>>> aniket.alhat@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Don't forget to rename file m2-pom.xml to pom.xml and also >>>>>>>>>>>>> post your directory "tree" structure. I want to check whether your source >>>>>>>>>>>>> WordCountTopology.java exists or not. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Dec 30, 2013 at 10:52 AM, Aniket Alhat < >>>>>>>>>>>>> aniket.alhat@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> cd Storm >>>>>>>>>>>>>> cd storm >>>>>>>>>>>>>> mvn clean install >>>>>>>>>>>>>> bin/storm jar /home/user/storm/storm-starter.jar >>>>>>>>>>>>>> "storm.starter.WordCountTopology" >>>>>>>>>>>>>> On Dec 30, 2013 4:41 AM, "researcher cs" < >>>>>>>>>>>>>> prog.researcher@gmail.com> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks >>>>>>>>>>>>>>> *Abhishek but i'm still until now have problem to find or >>>>>>>>>>>>>>> load main class when i wrote this command *user@ubuntu:~/Storm/storm$ >>>>>>>>>>>>>>> bin/storm jar /home/user/storm/storm-starter.jar >>>>>>>>>>>>>>> storm.starter.WordCountTopology wordcount !! >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Sun, Dec 29, 2013 at 10:17 AM, Abhishek Bhattacharjee < >>>>>>>>>>>>>>> abhishek.bhattacharjee11@gmail.com> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> It seems at the first try the .jar file was not created and >>>>>>>>>>>>>>>> that is why the class file could not be found. And while submitting the >>>>>>>>>>>>>>>> topology you should submit the whole path(i.e the absolute path of the jar >>>>>>>>>>>>>>>> file). >>>>>>>>>>>>>>>> The command mvn -f m2-pom.xml compile exec:java >>>>>>>>>>>>>>>> -Dstorm.topology=storm.starter.WordCountTopology >>>>>>>>>>>>>>>> is used to run the topology. If you just want to build the >>>>>>>>>>>>>>>> jar file use mvn package or lein uberjar. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The second question about the jar with dependecies , a >>>>>>>>>>>>>>>> standalone jar is a smaller jar and it doesn't have all the class files >>>>>>>>>>>>>>>> that are necessary to run a Topology whereas a jar with dependencies is a >>>>>>>>>>>>>>>> much bigger jar with all the dependencies. But I think from storm >>>>>>>>>>>>>>>> perspective you should use the standalone jar not the jar with dependencies. >>>>>>>>>>>>>>>> I hope this helps. If you find something wrong please >>>>>>>>>>>>>>>> revert back. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Cheers, >>>>>>>>>>>>>>>> *Abhishek Bhattacharjee* >>>>>>>>>>>>>>>> *Pune Institute of Computer Technology* >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> >>>>>>>>>>>>> *Aniket Alhatlinkedin.com/in/aniketalhat >>>>>>>>>>>>> * >>>>>>>>>>>>> *+91 976 603 9317 <%2B91%20976%20603%209317>* >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *Abhishek Bhattacharjee* >>>>>>>>>>> *Pune Institute of Computer Technology* >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>> >>>>>> >>>> >>> >> > --001a11c2542813f42004eef49862 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

No, maven can manage the entire project life cycle including= compilation and packaging into a jar file.

On Jan 1, 2014 7:01 PM, "researcher cs"= ; <prog.researcher@gmail.co= m> wrote:
do you mean that compiling WordCountTopology class using E= clipse or netbeans and then trying to implement storm jar ?


On Thu, Jan 2, 2014= at 1:54 AM, Nathan Leung <ncleung@gmail.com> wrote:
= It looks like for some reason the java file got included as a text file, no= t compiled as a class file. =A0My recommendation is, since you do not seem = to be able to diagnose that yourself, you should familiarize yourself with = the toolchain, including jdk tools and maven. =A0Then you will be able to d= ebug this problem yourself. =A0:)


On Wed, Jan 1, 2014 at 5:52 PM, researcher c= s <prog.researcher@gmail.com> wrote:
i really wonder why storm j= ar can't find or load main class of wordcounttopology ..?


On Thu, = Jan 2, 2014 at 12:38 AM, researcher cs <prog.researcher@gmail.com<= /a>> wrote:
Nathan , i tried searc= hing WordCountTopology in storm-starter
wrote this command <= br> user@ubuntu:~/Storm/storm-0.8.2$ jar -tf storm-starter.jar
and got
storm-starter/src/jvm/storm/starter/WordCountTopology.java
=


On Tue, Dec 31, 2013 at 10:59 PM, Nathan Leung &= lt;ncleung@gmail.com= > wrote:

Yes

On Dec 31, 2013 2:58 PM, "researcher cs&quo= t; <prog.= researcher@gmail.com> wrote:
Nathan , Do you mean by jar -tf for searching WordCountTop= ology in storm-starter.jar or what ... ?


On Tue, Dec 31, 2013 at 9:24 PM, Natha= n Leung <ncleung@gmail.com> wrote:

If the jar file is in fact in= the location you expect it you can also jar -tf on the file and search for= the WordCountTopology.

On Dec 31, 2013 1:37 PM, "researcher cs&quo= t; <prog.= researcher@gmail.com> wrote:
Yes,Nathan I've storm-starter.jar and installed m= aven and run topology successfully


On Tue, Dec 31, 2013 at 3:06 PM, Natha= n Leung <ncleung@gmail.com> wrote:

Do you have a file storm-star= ter.jar? This doesn't match the snapshot naming that maven created for = the "with dependencies" jar file. Also did you do mvn install?

-Nathan

On Dec 31, 2013 12:55 AM, "researcher cs&qu= ot; <prog= .researcher@gmail.com> wrote:
Thanks Abhishek for replying
Steps
= 1- After installed storm .. i downloaded storm-starter to run it on storm <= br>
2- running WordCountTopology using maven "build suc= cessfully"
3- trying to submit a topology on storm ui . using storm jar
4- i used storm jar SNAPSHOT with dependencies and worked well .= .
5- trying to use storm jar=A0 user@ubuntu:~/Storm/st= orm$ bin/storm jar storm-starter.jar storm.starter.WordCountTopology wordco= unt but it didn't work got this error "cannot find or load main cl= ass of WordCountTopology"

but i want to tell you something i guessed that= it's the reason
when i imported pack= age of storm starter in Eclipse to run code of it .. i found error it's= backtype package not defined !!


= On Tue, Dec 31, 2013 at 6:44 AM, Abhishek Bhattacharjee &= lt;= abhishek.bhattacharjee11@gmail.com> wrote:
What are you doing exa= ctly could you send the steps you are following ? If you are having problem= s with mvn use lein.
Send the logs of what you are doing that will help us understand why = exactly you are getting the error.


On Tue, Dec 31, 2013 at 4:15 AM, researcher cs <prog.researcher= @gmail.com> wrote:
Thanks Aniket

= problem still persist after mvn clean install

for your questi= on do you mean that
/home/usr/Storm/storm/storm-starter/src/jvm/storm/starter/WordCountTopology.java



On Mon, Dec 30, 2013 at 10:25 AM, Aniket Alhat <aniket.a= lhat@gmail.com> wrote:
Don't forget to rename = file m2-pom.xml to pom.xml and also post your directory "tree" st= ructure. I want to check whether your source WordCountTopology.java exists = or not.


On Mon, Dec 30, 2013 at 10:52 AM, Aniket= Alhat <aniket.alhat@gmail.com> wrote:

cd Storm
cd storm
mvn clean install
bin/storm jar /home/user/storm/storm-starter.jar "storm.starter.WordCo= untTopology"

On Dec 30, 2013 4:41 AM, "researcher cs&quo= t; <prog.= researcher@gmail.com> wrote:
Thanks Abhishek but i'm still until now have proble= m to find or load main class when i wrote this command
user@u= buntu:~/Storm/storm$ bin/storm jar /home/user/storm/storm-starter.jar storm= .starter.WordCountTopology wordcount !!



On = Sun, Dec 29, 2013 at 10:17 AM, Abhishek Bhattacharjee <= ;ab= hishek.bhattacharjee11@gmail.com> wrote:
It seems at the first try t= he .jar file was not created and that is why the class file could not be fo= und. And while submitting the topology you should submit the whole path(i.e= the absolute path of the jar file).
The command=A0=A0mvn -f m2-pom.xml compile exec:java -Dstorm.topology=3Ds= torm.starter.WordCountTopology
is used to run the top= ology. If you just want to build the jar file use mvn package or lein uberj= ar.

The second question about the jar with depende= cies , a standalone jar is a smaller jar and it doesn't have all the cl= ass files that are necessary to run a Topology whereas a jar with dependenc= ies is a much bigger jar with all the dependencies. But I think from storm = perspective you should use the standalone jar not the jar with dependencies= .
I hope this helps. If you find something wrong please revert back.=A0<= /div>

Cheers,
Abhishek Bhattacharjee
Pune Instit= ute of Computer Technology




= --




--
Abhishek Bhattacharjee
Pune Institute of Computer Technology







--001a11c2542813f42004eef49862--