Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A1CA3DB00 for ; Tue, 4 Sep 2012 10:01:58 +0000 (UTC) Received: (qmail 6195 invoked by uid 500); 4 Sep 2012 10:01:53 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 5951 invoked by uid 500); 4 Sep 2012 10:01:53 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 5921 invoked by uid 99); 4 Sep 2012 10:01:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Sep 2012 10:01:51 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of visioner.sadak@gmail.com designates 209.85.215.176 as permitted sender) Received: from [209.85.215.176] (HELO mail-ey0-f176.google.com) (209.85.215.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Sep 2012 10:01:45 +0000 Received: by eabd1 with SMTP id d1so2052853eab.35 for ; Tue, 04 Sep 2012 03:01:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=/OOISzviyx0LwCuMC0zilSaDs1JmHr6YrNyiYr8+DjE=; b=G9Dzj7Qjfc5HWoTEdTnsp8fX8aSc5y9d59bp5+ztcvRl0dYELzTwsshup5FSUVG4J1 UYR6omK5VP9KVdgTlTXWsVg+5RyufZG9+jDqQu0HW7AkhGllPhz1tUb/BYCc6J2yZUjg R7VAPvkAajmFEUCXl3xGH9uvqBHlFNY645kOhf07hdpsRFY+CK5NDxvOTXUYN8sl1ty+ 3V2T/AY3mVJwFETSilFNkfAc4ZGz7j+1vUxMupQxnmUcWxyoh5M8/bpFh/ZUboLg+JGv dtJBelh0fMjbGgU2z6+ohXdqrmJc9/QRUym6Fbk2qfdeNSw8hiV5wfMJjzxXYetUH6w2 tM3w== MIME-Version: 1.0 Received: by 10.14.215.197 with SMTP id e45mr25249985eep.36.1346752885445; Tue, 04 Sep 2012 03:01:25 -0700 (PDT) Received: by 10.14.220.134 with HTTP; Tue, 4 Sep 2012 03:01:25 -0700 (PDT) In-Reply-To: References: Date: Tue, 4 Sep 2012 15:31:25 +0530 Message-ID: Subject: Re: Integrating hadoop with java UI application deployed on tomcat From: Visioner Sadak To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b603d1856547a04c8dd5719 --047d7b603d1856547a04c8dd5719 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable also getting one more error * org.apache.hadoop.ipc.RemoteException*: Server IPC version 5 cannot communicate with client version 4 On Tue, Sep 4, 2012 at 2:44 PM, Visioner Sadak wr= ote: > Thanks shobha tried adding conf folder to tomcats classpath still gettin= g > same error > > > Call to localhost/127.0.0.1:9000 failed on local exception: > java.io.IOException: An established connection was aborted by the softwar= e > in your host machine > > On Tue, Sep 4, 2012 at 11:18 AM, Mahadevappa, Shobha < > Shobha.Mahadevappa@nttdata.com> wrote: > >> Hi,**** >> >> Try adding the hadoop/conf directory in the TOMCAT=92s classpath **** >> >> ** ** >> >> Ex : >> CLASSPATH=3D/usr/local/Apps/hbase-0.90.4/conf:/usr/local/Apps/hadoop-0.2= 0.203.0/conf: >> **** >> >> ** ** >> >> ** ** >> >> ** ** >> >> Regards,**** >> >> *Shobha M ***** >> >> ** ** >> >> *From:* Visioner Sadak [mailto:visioner.sadak@gmail.com] >> *Sent:* 03 September 2012 PM 04:01 >> *To:* user@hadoop.apache.org >> >> *Subject:* Re: Integrating hadoop with java UI application deployed on >> tomcat**** >> >> ** ** >> >> Thanks steve thers nothing in logs and no exceptions as well i found tha= t >> some file is created in my F:\user with directory name but its not visib= le >> inside my hadoop browse filesystem directories i also added the config b= y >> using the below method **** >> >> hadoopConf.addResource(**** >> >> "F:/hadoop-0.22.0/conf/core-site.xml"); **** >> >> when running thru WAR printing out the filesystem i m getting >> org.apache.hadoop.fs.LocalFileSystem@9cd8db **** >> >> when running an independet jar within hadoop i m getting >> DFS[DFSClient[clientName=3DDFSClient_296231340, ugi=3Ddell]]**** >> >> when running an independet jar i m able to do uploads....**** >> >> **** >> >> just wanted to know will i have to add something in my classpath of >> tomcat or is there any other configurations of core-site.xml that i am >> missing out..thanks for your help.....**** >> >> **** >> >> ** ** >> >> On Sat, Sep 1, 2012 at 1:38 PM, Steve Loughran >> wrote:**** >> >> ** ** >> >> well, it's worked for me in the past outside Hadoop itself:**** >> >> ** ** >> >> >> http://smartfrog.svn.sourceforge.net/viewvc/smartfrog/trunk/core/hadoop-= components/hadoop-ops/src/org/smartfrog/services/hadoop/operations/utils/Df= sUtils.java?revision=3D8882&view=3Dmarkup >> **** >> >> ** ** >> >> 1. Turn logging up to DEBUG**** >> 2. Make sure that the filesystem you've just loaded is what you >> expect, by logging its value. It may turn out to be file:///, because >> the normal Hadoop site-config.xml isn't being picked up**** >> >> **** >> >> ** ** >> >> On Fri, Aug 31, 2012 at 1:08 AM, Visioner Sadak >> wrote:**** >> >> but the problem is that my code gets executed with the warning but file >> is not copied to hdfs , actually i m trying to copy a file from local to >> hdfs **** >> >> **** >> >> Configuration hadoopConf=3Dnew Configuration(); >> //get the default associated file system >> FileSystem fileSystem=3DFileSystem.get(hadoopConf); >> // HarFileSystem harFileSystem=3D new HarFileSystem(fileSystem); >> //copy from lfs to hdfs >> fileSystem.copyFromLocalFile(new Path("E:/test/GANI.jpg"),new >> Path("/user/TestDir/")); **** >> >> **** >> >> ** ** >> >> ** ** >> >> >> ______________________________________________________________________ >> Disclaimer:This email and any attachments are sent in strictest >> confidence for the sole use of the addressee and may contain legally >> privileged, confidential, and proprietary data. If you are not the inten= ded >> recipient, please advise the sender by replying promptly to this email a= nd >> then delete and destroy this email and any attachments without any furth= er >> use, copying or forwarding >> > > --047d7b603d1856547a04c8dd5719 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable
also getting one more error
=A0

org.apache.hadoop.ipc.RemoteException

: Server IPC version 5 cannot communic= ate with client version 4

On Tue, Sep 4, 2012 at 2:44 PM, Visioner Sadak <= span dir=3D"ltr"><visioner.sadak@gmail.com> wrote:
Thanks shobha tried adding conf folder to tomcats classpath=A0 still g= etting same error
=A0
=A0
Call to localhost/127.0.0.1:9000 failed on local exception: java.io.IOException: An esta= blished connection was aborted by the software in your host machine
On Tue, Sep 4, 2012 at 11:18 AM, Mahadevappa, Sh= obha <Shobha.Mahadevappa@nttdata.com> wrote:

Hi,

Try adding the hadoop/conf dire= ctory in the TOMCAT=92s classpath

=A0

Ex : CLASSPATH=3D/usr/local/App= s/hbase-0.90.4/conf:/usr/local/Apps/hadoop-0.20.203.0/conf:

=A0

=A0

=A0

Regards,

Shobha M

=A0

From: Visioner Sadak [mailto:visioner.sadak@gmail.com]
Sent: 03 September 2012 PM 04:01
To: user@hadoop.apache.org=20


Subject: Re: Integrating hadoop with java UI application de= ployed on tomcat

=A0

Thanks steve thers nothing in logs and no exceptions= as well i found that some file is created in my F:\user with directory nam= e but its not visible inside my hadoop browse filesystem directories i also= added the config by using the below method

hadoopConf.addResource(

"F:/hadoop-0.22.0= /conf/core-site.xml");

when running thru WAR printing out the filesystem i = m getting org.apache.hadoop.fs.LocalFileSystem@9cd8db=A0

when running an independet jar within hadoop i m get= ting DFS[DFSClient[clientName=3DDFSClient_296231340, ugi=3Ddell]]=

when running an independet jar i m able to do upload= s....

=A0

just wanted to know will i have to add something in = my classpath of tomcat or is there any other configurations of core-site.xml that i am missing out..thanks for your hel= p.....

=A0

=A0

On Sat, Sep 1, 2012 at 1:38 PM, Steve Loughran <<= a href=3D"mailto:stevel@hortonworks.com" target=3D"_blank">stevel@hortonwor= ks.com> wrote:

=A0

well, it's worked for me in the past outside Had= oop itself:

=A0

=A0

  1. Turn logging up to DEBUG
  2. Make sure that the filesystem you've just loade= d is what you expect, by logging its value. It may turn out to be file:/= //, because the normal Hadoop site-config.xml isn't being picked up=

=A0

=A0

On Fri, Aug 31, 2012 at 1:08 AM, Visioner Sadak <= visioner.sada= k@gmail.com> wrote:

but the problem is that my=A0 code gets executed wit= h the warning but file is not copied to hdfs , actually i m trying to copy = a file from local to hdfs

=A0

=A0=A0 Configuration hadoopConf=3Dnew Configuration(= );
=A0=A0=A0=A0=A0=A0=A0 //get the default associated file system
=A0= =A0=A0=A0=A0=A0 FileSystem fileSystem=3DFileSystem.get(hadoopConf);=A0=A0= =A0=A0=A0=A0=A0
=A0=A0=A0=A0=A0=A0 // HarFileSystem harFileSystem=3D ne= w HarFileSystem(fileSystem);
=A0=A0=A0=A0=A0=A0=A0 //copy from lfs to hdfs
=A0=A0=A0=A0=A0=A0 fileSys= tem.copyFromLocalFile(new Path("E:/test/GANI.jpg"),new Path("= ;/user/TestDir/"));

=A0

<= /div>

=A0

=A0


_______________________________________= _______________________________
Disclaimer:This email and any attachment= s are sent in strictest confidence for the sole use of the addressee and ma= y contain legally privileged, confidential, and proprietary data. If you ar= e not the intended recipient, please advise the sender by replying promptly= to this email and then delete and destroy this email and any attachments w= ithout any further use, copying or forwarding


--047d7b603d1856547a04c8dd5719--