Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8B438748B for ; Fri, 9 Dec 2011 09:40:43 +0000 (UTC) Received: (qmail 43453 invoked by uid 500); 9 Dec 2011 09:40:42 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 43342 invoked by uid 500); 9 Dec 2011 09:40:38 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 43323 invoked by uid 99); 9 Dec 2011 09:40:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Dec 2011 09:40:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of stutiawasthi@hcl.com designates 203.105.185.23 as permitted sender) Received: from [203.105.185.23] (HELO gws05.hcl.com) (203.105.185.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Dec 2011 09:40:26 +0000 Received: from NDA-HCLIN-HT01.CORP.HCL.IN (10.248.64.35) by NDA-HCLIN-EDGE3.hcl.in (10.248.64.140) with Microsoft SMTP Server id 8.2.254.0; Fri, 9 Dec 2011 15:10:57 +0530 Received: from NDA-HCLC-HT02.HCLC.CORP.HCL.IN (10.33.64.134) by NDA-HCLIN-HT01.CORP.HCL.IN (10.248.64.35) with Microsoft SMTP Server (TLS) id 8.2.254.0; Fri, 9 Dec 2011 15:09:55 +0530 Received: from NDA-HCLC-EVS04.HCLC.CORP.HCL.IN ([10.33.64.194]) by NDA-HCLC-HT02.HCLC.CORP.HCL.IN ([::1]) with mapi; Fri, 9 Dec 2011 15:09:55 +0530 From: Stuti Awasthi To: "hdfs-user@hadoop.apache.org" Date: Fri, 9 Dec 2011 15:09:54 +0530 Subject: RE: Facing issue in building Fuse-DFS Thread-Topic: Facing issue in building Fuse-DFS Thread-Index: Acy1mvp52nPJxcaWRG2LTUB/9JdHbAAutoJw Message-ID: <7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF984@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> References: <7D9AF4B98807C54EBADEA75DF6D5ACB7E31A882D@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> <7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF510@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> <7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF5DC@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> <7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF663@NDA-HCLC-EVS04.HCLC.CORP.HCL.IN> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF984NDAHCLCEVS04HCL_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF984NDAHCLCEVS04HCL_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi Kartheek, Alo Good news is I am finally able to build fuse-dfs successfully. After the bu= ild now build/contrib/fuse-dfs/fuse_dfs is created. Issue was with libhdfs which was not compiling properly. Command which worked for me : ant compile-c++-libhdfs -Dlibhdfs=3D1 -Dislibhdfs=3D1 When now I try to mount, I am getting ClientProtocol version mismatch error= . This is common error in HDFS related to correct jar files in class path. = I will try to resolve it and will get back if faces any issues. ThankU Guys so much for help. Cheers From: kartheek muthyala [mailto:kartheek0274@gmail.com] Sent: Thursday, December 08, 2011 4:47 PM To: hdfs-user@hadoop.apache.org Subject: Re: Facing issue in building Fuse-DFS Hi stuti, I have installed fuse_dfs in ubuntu lot of times. I have written a script f= or this. See if this helps ant compile -Dcompile.c++=3Dtrue -Dlibhdfs=3Dtrue ant -Dcompile.native=3Dtrue package -Djava5.home=3D/usr/lib/jvm/java-1.5.0-= sun -Dforrest.home=3D/p/apache-forrest-0.8 ant compile-contrib -Dlibhdfs=3D1 -Dfusedfs=3D1 -Djava5.home=3D/usr/lib/jvm= /java-1.5.0-sun ~Kartheek On Thu, Dec 8, 2011 at 3:01 PM, Stuti Awasthi > wrote: The environment variable which I set : export ANT_HOME=3D/home/stuti/Installer/apache-ant-1.8.2/ export PATH=3D$PATH:/home/stuti/Installer/apache-ant-1.8.2/bin/ export HADOOP_HOME=3D/home/stuti/Installer/hadoop-0.20.2/ export JAVA_HOME=3D/usr/lib/jvm/java-6-openjdk/ export PATH=3D$PATH:/usr/lib/jvm/java-6-openjdk/bin/ ln -s /home/stuti/Installer/hadoop-0.20.2/build/c++/Linux-i386-32/lib $HAD= OOP_HOME/build/libhdfs export LD_LIBRARY_PATH=3D/usr/lib:/usr/local/lib:$HADOOP_HOME/build/libhdf= s:$JAVA_HOME/jre/lib/i386/server/ export FUSE_HOME=3D/usr/include/fuse export LD_LIBRARY_PATH=3D$LD_LIBRARY_PATH:/usr/lib/libfuse.so -----Original Message----- From: Stuti Awasthi Sent: Thursday, December 08, 2011 2:53 PM To: hdfs-user@hadoop.apache.org Subject: RE: Facing issue in building Fuse-DFS Here are the build logs. I also found out that after building no folder of = fuse-dfs is created inside $HADOOP_HOME/build/ Logs are : 1. ant compile-c++-libhdfs -Dlibhdfs=3D1 > compile.txt 2. ant -Djava5.home= =3D/home/stuti/Installer/JDK1.5/jdk1.5.0_22/ -Dforrest.home=3D/home/stuti/I= nstaller/apache-forrest-0.8/ package > package.txt 3. ant compile-contrib -= Dlibhdfs=3D1 -Dfusedfs=3D1 > compile-contrib.txt I have also fired command : "ant compile -Dcompile.c++=3Dtrue -Dlibhdfs=3Dt= rue " which I have not captured in logs. Let me know if that is also requir= ed. Thanks From: alo alt [mailto:wget.null@googlemail.com] Sent: Thursday, December 08, 2011 1:42 PM To: hdfs-user@hadoop.apache.org Subject: Re: Facing issue in building Fuse-DFS Hi Stuti, I've build them on CentOS, with Ubuntu I never tried. Could you please send= the buildlog? On my servers fuse_dfs is found under /usr/lib/hadoop-0.20/b= in/ - alex On Thu, Dec 8, 2011 at 9:00 AM, Stuti Awasthi > wrote: Hi Alo, My architecture is i386 . I am using Ubuntu 11.4 and added required fuse pa= ckages in it. I am not getting any build errors now. Initially I got many b= uild errors but now I have overcome by including correct packages and expo= rting correct environment variables. Thanks From: alo alt [mailto:wget.null@googlemail.com] Sent: Thursday, December 08, 2011 1:19 PM To: hdfs-user@hadoop.apache.org Subject: Re: Facing issue in building Fuse-DFS Hi Stuti, what architecture do you have? If AMD64 lib_fuse wont be build unless you e= dit the makefile to macht the architecture. Also your kernel has fuse-suppo= rt included? - alex On Thu, Dec 8, 2011 at 5:34 AM, Stuti Awasthi > wrote: Hi all, I am successful in building Fuse-Dfs but facing issue that executable fuse_= dfs is not getting created but build is getting successful. I followed : http://wiki.apache.org/hadoop/MountableHDFS Got Build Successful by executing. Exported required paths in environment in HADOOP_HOME: ant compile-c++-libhdfs -Dlibhdfs=3D1 in HADOOP_HOME: ant p= ackage to deploy libhdfs in HADOOP_HOME: ant compile-contrib -Dlibhdfs=3D1 = -Dfusedfs=3D1 Configured fuse_dfs_wrapper.sh present in $HADOOP_HOME/src/contrib/fuse-dfs= /src with JAVA_HOME and HADOOP_HOME And executed fuse_dfs_wrapper.sh but go= t the error : fuse_dfs: not found I searched but cant find fuse_dfs executable after the build. What I have d= one wrong. Did I missed anything. Please Help. I am so close to get this done. -----Original Message----- From: Stuti Awasthi Sent: Wednesday, November 30, 2011 4:11 PM To: 'hdfs-user@hadoop.apache.org' Subject: RE: Facing issue in building Fuse-DFS Hi, I also tried "hdfs-1757-1.patch" but unsuccessful to apply it correctly. cd $HADOOP_HOME patch -p1 < ~/Downloads/ hdfs-1757-1.patch Got errors :( -----Original Message----- From: Stuti Awasthi Sent: Wednesday, November 30, 2011 3:48 PM To: hdfs-user@hadoop.apache.org Subject: RE: Facing issue in building Fuse-DFS Hi, After some googling I found this link : http://search-hadoop.com/m/Ee9Vj1ZNSGR1&subj=3DRe+Hadoop+Hdfs+trunk+Commit+= Build+560+Failure I tried to apply patch but getting errors in applying the patch. Here is what I did : cd $HADOOP_HOME patch -p1 < ~/Downloads/hdfs-780-4.patch But got the errors. Please help. -----Original Message----- From: Stuti Awasthi Sent: Wednesday, November 30, 2011 2:19 PM To: hdfs-user@hadoop.apache.org Subject: Facing issue in building Fuse-DFS Hi All, I am using Hadoop 0.20.2 and tried to build Fuse DFS. After facing lots of = issues and resolving them I am stuck at the following error. Can please somebody help me in resolving this . Command : ant compile-contrib -Dlibhdfs=3D1 -Dfusedfs=3D1 Error: [exec] make[1]: Entering directory `/home/stuti/Installer/hadoop-0.20.2/src= /contrib/fuse-dfs' [exec] make[1]: Nothing to be done for `all-am'. [exec] make[1]: Leaving directory `/home/stuti/Installer/hadoop-0.20.2/= src/contrib/fuse-dfs' [exec] Making all in src [exec] make[1]: Entering directory `/home/stuti/Installer/hadoop-0.20.2= /src/contrib/fuse-dfs/src' [exec] gcc -DPACKAGE_NAME=3D\"fuse_dfs\" -DPACKAGE_TARNAME=3D\"fuse_dfs= \" -DPACKAGE_VERSION=3D\"0.1.0\" -DPACKAGE_STRING=3D\"fuse_dfs\ 0.1.0\" -DP= ACKAGE_BUGREPORT=3D\"\" -DPACKAGE_URL=3D\"\" -DSTDC_HEADERS=3D1 -DHAVE_SYS_= TYPES_H=3D1 -DHAVE_SYS_STAT_H=3D1 -DHAVE_STDLIB_H=3D1 -DHAVE_STRING_H=3D1 -= DHAVE_MEMORY_H=3D1 -DHAVE_STRINGS_H=3D1 -DHAVE_INTTYPES_H=3D1 -DHAVE_STDINT= _H=3D1 -DHAVE_UNISTD_H=3D1 -DGETGROUPS_T=3Dgid_t -DHAVE_GETGROUPS=3D1 -DGET= GROUPS_T=3Dgid_t -I. -DPERMS=3D1 -D_FILE_OFFSET_BITS=3D64 -I/usr/lib/jvm/j= ava-6-openjdk//include -I/home/stuti/Installer/hadoop-0.20.2/src/c++/libhdf= s/ -I/usr/lib/jvm/java-6-openjdk//include/linux/ -D_FUSE_DFS_VERSION=3D\"0.= 1.0\" -DPROTECTED_PATHS=3D\"\" -I/usr/include/fuse/include -Wall -O3 -MT = fuse_dfs.o -MD -MP -MF .deps/fuse_dfs.Tpo -c -o fuse_dfs.o fuse_dfs.c [exec] make[1]: Leaving directory `/home/stuti/Installer/hadoop-0.20.2/= src/contrib/fuse-dfs/src' [exec] In file included from fuse_dfs.c:21:0: [exec] fuse_impls.h:37:46: error: expected declaration specifiers or '.= ..' before 'fuse_fill_dir_t' [exec] fuse_impls.h:38:38: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:38:38: warning: its scope is only this definition o= r declaration, which is probably not what you want [exec] fuse_impls.h:40:28: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:41:41: warning: 'struct statvfs' declared inside pa= rameter list [exec] fuse_impls.h:49:39: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:51:36: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:52:43: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:54:54: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_impls.h:55:40: warning: 'struct fuse_file_info' declared in= side parameter list [exec] fuse_dfs.c: In function 'is_protected': [exec] fuse_dfs.c:27:3: warning: implicit declaration of function 'fuse= _get_context' [exec] fuse_dfs.c:27:54: error: invalid type argument of '->' (have 'in= t') [exec] fuse_dfs.c: At top level: [exec] fuse_dfs.c:40:15: error: variable 'dfs_oper' has initializer but= incomplete type [exec] fuse_dfs.c:41:3: error: unknown field 'getattr' specified in ini= tializer [exec] fuse_dfs.c:41:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:41:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:42:3: error: unknown field 'access' specified in init= ializer [exec] fuse_dfs.c:42:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:42:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:43:3: error: unknown field 'readdir' specified in ini= tializer [exec] fuse_dfs.c:43:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:43:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:44:3: error: unknown field 'destroy' specified in ini= tializer [exec] fuse_dfs.c:44:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:44:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:45:3: error: unknown field 'init' specified in initia= lizer [exec] fuse_dfs.c:45:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:45:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:46:3: error: unknown field 'open' specified in initia= lizer [exec] fuse_dfs.c:46:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:46:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:47:3: error: unknown field 'read' specified in initia= lizer [exec] fuse_dfs.c:47:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:47:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:48:3: error: unknown field 'symlink' specified in ini= tializer [exec] fuse_dfs.c:48:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:48:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:49:3: error: unknown field 'statfs' specified in init= ializer [exec] fuse_dfs.c:49:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:49:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:50:3: error: unknown field 'mkdir' specified in initi= alizer [exec] fuse_dfs.c:50:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:50:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:51:3: error: unknown field 'rmdir' specified in initi= alizer [exec] fuse_dfs.c:51:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:51:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:52:3: error: unknown field 'rename' specified in init= ializer [exec] fuse_dfs.c:52:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:52:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:53:3: error: unknown field 'unlink' specified in init= ializer [exec] fuse_dfs.c:53:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:53:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:54:3: error: unknown field 'release' specified in ini= tializer [exec] fuse_dfs.c:54:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:54:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:55:3: error: unknown field 'create' specified in init= ializer [exec] fuse_dfs.c:55:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:55:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:56:3: error: unknown field 'write' specified in initi= alizer [exec] fuse_dfs.c:56:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:56:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:57:3: error: unknown field 'flush' specified in initi= alizer [exec] fuse_dfs.c:57:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:57:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:58:3: error: unknown field 'mknod' specified in initi= alizer [exec] fuse_dfs.c:58:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:58:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:59:2: error: unknown field 'utimens' specified in ini= tializer [exec] fuse_dfs.c:59:2: warning: excess elements in struct initializer [exec] fuse_dfs.c:59:2: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:60:3: error: unknown field 'chmod' specified in initi= alizer [exec] fuse_dfs.c:60:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:60:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:61:3: error: unknown field 'chown' specified in initi= alizer [exec] fuse_dfs.c:61:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:61:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c:62:3: error: unknown field 'truncate' specified in in= itializer [exec] fuse_dfs.c:62:3: warning: excess elements in struct initializer [exec] fuse_dfs.c:62:3: warning: (near initialization for 'dfs_oper') [exec] fuse_dfs.c: In function 'main': [exec] fuse_dfs.c:132:3: warning: implicit declaration of function 'fus= e_main' [exec] make[1]: *** [fuse_dfs.o] Error 1 [exec] make: *** [all-recursive] Error 1 BUILD FAILED /home/stuti/Installer/hadoop-0.20.2/build.xml:497: The following error occu= rred while executing this line: /home/stuti/Installer/hadoop-0.20.2/src/contrib/build.xml:30: The following= error occurred while executing this line: /home/stuti/Installer/hadoop-0.20.2/src/contrib/fuse-dfs/build.xml:57: exec= returned: 2 -Stuti ::DISCLAIMER:: ---------------------------------------------------------------------------= -------------------------------------------- The contents of this e-mail and any attachment(s) are confidential and inte= nded for the named recipient(s) only. It shall not attach any liability on the originator or HCL or its affiliate= s. Any views or opinions presented in this email are solely those of the au= thor and may not necessarily reflect the opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,= distribution and / or publication of this message without the prior writte= n consent of the author of this e-mail is strictly prohibited. If you have = received this email in error please delete it and notify the sender immedia= tely. Before opening any mail and attachments please check them for viruses= and defect. ---------------------------------------------------------------------------= -------------------------------------------- -- Alexander Lorenz http://mapredit.blogspot.com P Think of the environment: please don't print this email unless you really= need to. -- Alexander Lorenz http://mapredit.blogspot.com P Think of the environment: please don't print this email unless you really= need to. --_000_7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF984NDAHCLCEVS04HCL_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi Karthe= ek, Alo

 <= /span>

Good news is I am finally able to bui= ld fuse-dfs successfully. After the build now build/contrib/fuse-dfs/fuse_d= fs is created.

Issue was w= ith libhdfs which was not compiling properly.

 

Command which worked for me :

ant compile-c++-libhdfs = ;-Dlibhdfs=3D1 -Dislibhdfs=3D1

 <= /span>

 

ThankU Guys so much for help.<= /span>

 

Cheers

 

 

 =

From: kartheek muthyala [mailto:kartheek0274@= gmail.com]
Sent: Thursday, December 08, 2011 4:47 PM
To: hdfs-user@hadoop.apache.org
Subject: Re: Facing issue in build= ing Fuse-DFS

 

Hi stuti,
I have in= stalled fuse_dfs in ubuntu lot of times. I have written a script for this. = See if this helps

ant compile -Dcompile.c++=3Dtrue -Dlibhdfs=3Dtrue<= br>ant -Dcompile.native=3Dtrue package -Djava5.home=3D/usr/lib/jvm/java-1.5= .0-sun -Dforrest.home=3D/p/apache-forrest-0.8
ant compile-contrib -Dlibh= dfs=3D1 -Dfusedfs=3D1 -Djava5.home=3D/usr/lib/jvm/java-1.5.0-sun

~Ka= rtheek

On Thu, Dec 8, 2011 = at 3:01 PM, Stuti Awasthi <stuti= awasthi@hcl.com> wrote:

The envir= onment variable which I set :

 export ANT_HOME=3D/home/stuti/In= staller/apache-ant-1.8.2/
 export PATH=3D$PATH:/home/stuti/Installe= r/apache-ant-1.8.2/bin/
 export HADOOP_HOME=3D/home/stuti/Installer= /hadoop-0.20.2/
 export JAVA_HOME=3D/usr/lib/jvm/java-6-openjdk/ export PATH=3D$PATH:/usr/lib/jvm/java-6-openjdk/bin/
 ln -s = /home/stuti/Installer/hadoop-0.20.2/build/c++/Linux-i386-32/lib $HADOOP_HOM= E/build/libhdfs
 export LD_LIBRARY_PATH=3D/usr/lib:/usr/local/lib:$= HADOOP_HOME/build/libhdfs:$JAVA_HOME/jre/lib/i386/server/
 export F= USE_HOME=3D/usr/include/fuse
 export LD_LIBRARY_PATH=3D$LD_LIBRARY_= PATH:/usr/lib/libfuse.so


-----O= riginal Message-----
From: Stuti Awasthi

Sent: Thursday, December 08, = 2011 2:53 PM
To: hdfs-use= r@hadoop.apache.org
Subject: RE: Facing issue in building Fuse-DFS

Here are the build logs. I also found out that after building no folder of= fuse-dfs is created inside $HADOOP_HOME/build/

Logs are :
1. ant=  compile-c++-libhdfs -Dlibhdfs=3D1 > compile.txt 2. ant -Djava= 5.home=3D/home/stuti/Installer/JDK1.5/jdk1.5.0_22/ -Dforrest.home=3D/home/s= tuti/Installer/apache-forrest-0.8/ package > package.txt 3. ant com= pile-contrib -Dlibhdfs=3D1 -Dfusedfs=3D1 > compile-contrib.txt=

I have also fired command : “ant compile -Dcompile.c++=3Dtrue= -Dlibhdfs=3Dtrue “ which I have not captured in logs. Let me know if= that is also required.

Thank= s

From: alo alt [mailto:= wget.null@googlemail.com]

Sent= : Thursday, December 08, 2011 1:42 PM

To: hdfs-user@hadoop.apache.org
Subject: Re: Facing issue= in building Fuse-DFS

Hi Stuti,

I've build them on CentOS, wi= th Ubuntu I never tried. Could you please send the buildlog? On my servers = fuse_dfs is found under /usr/lib/hadoop-0.20/bin/

- alex
On = Thu, Dec 8, 2011 at 9:00 AM, Stuti Awasthi <stutiawasthi@hcl.com> wrote:
Hi Alo,
My architectu= re is i386 . I am using Ubuntu 11.4 and added required fuse packages in it.= I am not getting any build errors now. Initially I got many build errors b= ut now I have overcome by including correct packages and  exporting co= rrect environment  variables.
 
Thanks
 
 <= br> 
From: alo alt [mailto:wget.null@googlemail.com]
Sent: Thursday, December 08, 2011 1:19= PM
To: hdfs-user@hadoop.= apache.org
Subject: Re: Facing issue in building Fuse-DFS
 <= br>Hi Stuti,
 
what architecture do you have? If AMD64 lib_fuse = wont be build unless you edit the makefile to macht the architecture. Also = your kernel has fuse-support included?
 
- alex
On Thu, Dec 8= , 2011 at 5:34 AM, Stuti Awasthi <stutiawasthi@hcl.com> wrote:
Hi all,
I am successful in buil= ding Fuse-Dfs but facing issue that executable fuse_dfs is not getting crea= ted but build is getting successful.
I followed : http://wiki.apache.org/= hadoop/MountableHDFS

Got Build Successful by executing. Exported= required paths in environment

in HADOOP_HOME: ant compile-c++-libhd= fs -Dlibhdfs=3D1 in HADOOP_HOME: ant package to deploy libhdfs in HADOOP_HO= ME: ant compile-contrib -Dlibhdfs=3D1 -Dfusedfs=3D1

Configured fuse_= dfs_wrapper.sh present in $HADOOP_HOME/src/contrib/fuse-dfs/src with JAVA_H= OME and HADOOP_HOME And executed fuse_dfs_wrapper.sh but got the error :fuse_dfs: not found

I searched but cant find fuse_dfs executable af= ter the build. What I have done wrong. Did I missed anything.
Please Hel= p. I am so close to get this done.


-----Original Message-----From: Stuti Awasthi
Sent: Wednesday, November 30, 2011 4:11 PM
To: '= hdfs-user@hadoop.apache.org<= /a>'
Subject: RE: Facing issue in building Fuse-DFS

Hi,
I also= tried "hdfs-1757-1.patch" but unsuccessful to apply it correctly= .

cd $HADOOP_HOME
patch -p1 < ~/Downloads/ hdfs-1757-1.patch
Got errors :(

-----Original Message-----
From: Stuti Awasth= i
Sent: Wednesday, November 30, 2011 3:48 PM
To: hdfs-user@hadoop.apache.org
Subject: RE: = Facing issue in building Fuse-DFS

Hi,
After some googling I found= this link :
http://= search-hadoop.com/m/Ee9Vj1ZNSGR1&subj=3DRe+Hadoop+Hdfs+trunk+Commit+Bui= ld+560+Failure

I tried to apply patch but getting errors in appl= ying the patch.
Here is what I did :

cd $HADOOP_HOME
patch -p1= < ~/Downloads/hdfs-780-4.patch

But got the errors. Please help.<= br>
-----Original Message-----
From: Stuti Awasthi
Sent: Wednesday= , November 30, 2011 2:19 PM
To: hdfs-user@hadoop.apache.org
Subject: Facing issue in building= Fuse-DFS Hi All,

I am using Hadoop 0.20.2 and tried to build Fuse D= FS. After facing lots of issues and resolving them I am stuck at the follow= ing error.
Can please somebody help me in resolving this .

Comman= d : ant compile-contrib -Dlibhdfs=3D1 -Dfusedfs=3D1

Error:
[exec]= make[1]: Entering directory `/home/stuti/Installer/hadoop-0.20.2/src/contr= ib/fuse-dfs'
    [exec] make[1]: Nothing to be done for `all-a= m'.
    [exec] make[1]: Leaving directory `/home/stuti/Install= er/hadoop-0.20.2/src/contrib/fuse-dfs'
    [exec] Making all i= n src
    [exec] make[1]: Entering directory `/home/stuti/Inst= aller/hadoop-0.20.2/src/contrib/fuse-dfs/src'
    [exec] gcc -= DPACKAGE_NAME=3D\"fuse_dfs\" -DPACKAGE_TARNAME=3D\"fuse_dfs\= " -DPACKAGE_VERSION=3D\"0.1.0\" -DPACKAGE_STRING=3D\"fu= se_dfs\ 0.1.0\" -DPACKAGE_BUGREPORT=3D\"\" -DPACKAGE_URL=3D\= "\" -DSTDC_HEADERS=3D1 -DHAVE_SYS_TYPES_H=3D1 -DHAVE_SYS_STAT_H= =3D1 -DHAVE_STDLIB_H=3D1 -DHAVE_STRING_H=3D1 -DHAVE_MEMORY_H=3D1 -DHAVE_STR= INGS_H=3D1 -DHAVE_INTTYPES_H=3D1 -DHAVE_STDINT_H=3D1 -DHAVE_UNISTD_H=3D1 -D= GETGROUPS_T=3Dgid_t -DHAVE_GETGROUPS=3D1 -DGETGROUPS_T=3Dgid_t -I.  -D= PERMS=3D1 -D_FILE_OFFSET_BITS=3D64 -I/usr/lib/jvm/java-6-openjdk//include -= I/home/stuti/Installer/hadoop-0.20.2/src/c++/libhdfs/ -I/usr/lib/jvm/java-6= -openjdk//include/linux/ -D_FUSE_DFS_VERSION=3D\"0.1.0\" -DPROTEC= TED_PATHS=3D\"\" -I/usr/include/fuse/include   -Wall -O3 -MT= fuse_dfs.o -MD -MP -MF .deps/fuse_dfs.Tpo -c -o fuse_dfs.o fuse_dfs.c
&= nbsp;   [exec] make[1]: Leaving directory `/home/stuti/Installer/hadoo= p-0.20.2/src/contrib/fuse-dfs/src'
    [exec] In file included= from fuse_dfs.c:21:0:
    [exec] fuse_impls.h:37:46: error: e= xpected declaration specifiers or '...' before 'fuse_fill_dir_t'
  =   [exec] fuse_impls.h:38:38: warning: 'struct fuse_file_info' declared= inside parameter list
    [exec] fuse_impls.h:38:38: warning:= its scope is only this definition or declaration, which is probably not wh= at you want
    [exec] fuse_impls.h:40:28: warning: 'struct fu= se_file_info' declared inside parameter list
    [exec] fuse_i= mpls.h:41:41: warning: 'struct statvfs' declared inside parameter list
&= nbsp;   [exec] fuse_impls.h:49:39: warning: 'struct fuse_file_info' de= clared inside parameter list
    [exec] fuse_impls.h:51:36: wa= rning: 'struct fuse_file_info' declared inside parameter list
  &nb= sp; [exec] fuse_impls.h:52:43: warning: 'struct fuse_file_info' declared in= side parameter list
    [exec] fuse_impls.h:54:54: warning: 's= truct fuse_file_info' declared inside parameter list
    [exec= ] fuse_impls.h:55:40: warning: 'struct fuse_file_info' declared inside para= meter list
    [exec] fuse_dfs.c: In function 'is_protected':<= br>    [exec] fuse_dfs.c:27:3: warning: implicit declaration of f= unction 'fuse_get_context'
    [exec] fuse_dfs.c:27:54: error:= invalid type argument of '->' (have 'int')
    [exec] fuse= _dfs.c: At top level:
    [exec] fuse_dfs.c:40:15: error: vari= able 'dfs_oper' has initializer but incomplete type
    [exec]= fuse_dfs.c:41:3: error: unknown field 'getattr' specified in initializer    [exec] fuse_dfs.c:41:3: warning: excess elements in struct = initializer
    [exec] fuse_dfs.c:41:3: warning: (near initial= ization for 'dfs_oper')
    [exec] fuse_dfs.c:42:3: error: unk= nown field 'access' specified in initializer
    [exec] fuse_d= fs.c:42:3: warning: excess elements in struct initializer
    = [exec] fuse_dfs.c:42:3: warning: (near initialization for 'dfs_oper')
&n= bsp;   [exec] fuse_dfs.c:43:3: error: unknown field 'readdir' specifie= d in initializer
    [exec] fuse_dfs.c:43:3: warning: excess e= lements in struct initializer
    [exec] fuse_dfs.c:43:3: warn= ing: (near initialization for 'dfs_oper')
    [exec] fuse_dfs.= c:44:3: error: unknown field 'destroy' specified in initializer
  &= nbsp; [exec] fuse_dfs.c:44:3: warning: excess elements in struct initialize= r
    [exec] fuse_dfs.c:44:3: warning: (near initialization fo= r 'dfs_oper')
    [exec] fuse_dfs.c:45:3: error: unknown field= 'init' specified in initializer
    [exec] fuse_dfs.c:45:3: w= arning: excess elements in struct initializer
    [exec] fuse_= dfs.c:45:3: warning: (near initialization for 'dfs_oper')
    = [exec] fuse_dfs.c:46:3: error: unknown field 'open' specified in initialize= r
    [exec] fuse_dfs.c:46:3: warning: excess elements in stru= ct initializer
    [exec] fuse_dfs.c:46:3: warning: (near init= ialization for 'dfs_oper')
    [exec] fuse_dfs.c:47:3: error: = unknown field 'read' specified in initializer
    [exec] fuse_= dfs.c:47:3: warning: excess elements in struct initializer
   = [exec] fuse_dfs.c:47:3: warning: (near initialization for 'dfs_oper')
&= nbsp;   [exec] fuse_dfs.c:48:3: error: unknown field 'symlink' specifi= ed in initializer
    [exec] fuse_dfs.c:48:3: warning: excess = elements in struct initializer
    [exec] fuse_dfs.c:48:3: war= ning: (near initialization for 'dfs_oper')
    [exec] fuse_dfs= .c:49:3: error: unknown field 'statfs' specified in initializer
  &= nbsp; [exec] fuse_dfs.c:49:3: warning: excess elements in struct initialize= r
    [exec] fuse_dfs.c:49:3: warning: (near initialization fo= r 'dfs_oper')
    [exec] fuse_dfs.c:50:3: error: unknown field= 'mkdir' specified in initializer
    [exec] fuse_dfs.c:50:3: = warning: excess elements in struct initializer
    [exec] fuse= _dfs.c:50:3: warning: (near initialization for 'dfs_oper')
   = [exec] fuse_dfs.c:51:3: error: unknown field 'rmdir' specified in initiali= zer
    [exec] fuse_dfs.c:51:3: warning: excess elements in st= ruct initializer
    [exec] fuse_dfs.c:51:3: warning: (near in= itialization for 'dfs_oper')
    [exec] fuse_dfs.c:52:3: error= : unknown field 'rename' specified in initializer
    [exec] f= use_dfs.c:52:3: warning: excess elements in struct initializer
  &n= bsp; [exec] fuse_dfs.c:52:3: warning: (near initialization for 'dfs_oper')<= br>    [exec] fuse_dfs.c:53:3: error: unknown field 'unlink' spec= ified in initializer
    [exec] fuse_dfs.c:53:3: warning: exce= ss elements in struct initializer
    [exec] fuse_dfs.c:53:3: = warning: (near initialization for 'dfs_oper')
    [exec] fuse_= dfs.c:54:3: error: unknown field 'release' specified in initializer
&nbs= p;   [exec] fuse_dfs.c:54:3: warning: excess elements in struct initia= lizer
    [exec] fuse_dfs.c:54:3: warning: (near initializatio= n for 'dfs_oper')
    [exec] fuse_dfs.c:55:3: error: unknown f= ield 'create' specified in initializer
    [exec] fuse_dfs.c:5= 5:3: warning: excess elements in struct initializer
    [exec]= fuse_dfs.c:55:3: warning: (near initialization for 'dfs_oper')
  &= nbsp; [exec] fuse_dfs.c:56:3: error: unknown field 'write' specified in ini= tializer
    [exec] fuse_dfs.c:56:3: warning: excess elements = in struct initializer
    [exec] fuse_dfs.c:56:3: warning: (ne= ar initialization for 'dfs_oper')
    [exec] fuse_dfs.c:57:3: = error: unknown field 'flush' specified in initializer
    [exe= c] fuse_dfs.c:57:3: warning: excess elements in struct initializer
 = ;   [exec] fuse_dfs.c:57:3: warning: (near initialization for 'dfs_ope= r')
    [exec] fuse_dfs.c:58:3: error: unknown field 'mknod' s= pecified in initializer
    [exec] fuse_dfs.c:58:3: warning: e= xcess elements in struct initializer
    [exec] fuse_dfs.c:58:= 3: warning: (near initialization for 'dfs_oper')
    [exec] fu= se_dfs.c:59:2: error: unknown field 'utimens' specified in initializer
&= nbsp;   [exec] fuse_dfs.c:59:2: warning: excess elements in struct ini= tializer
    [exec] fuse_dfs.c:59:2: warning: (near initializa= tion for 'dfs_oper')
    [exec] fuse_dfs.c:60:3: error: unknow= n field 'chmod' specified in initializer
    [exec] fuse_dfs.c= :60:3: warning: excess elements in struct initializer
    [exe= c] fuse_dfs.c:60:3: warning: (near initialization for 'dfs_oper')
 =   [exec] fuse_dfs.c:61:3: error: unknown field 'chown' specified in i= nitializer
    [exec] fuse_dfs.c:61:3: warning: excess element= s in struct initializer
    [exec] fuse_dfs.c:61:3: warning: (= near initialization for 'dfs_oper')
    [exec] fuse_dfs.c:62:3= : error: unknown field 'truncate' specified in initializer
   = [exec] fuse_dfs.c:62:3: warning: excess elements in struct initializer
=     [exec] fuse_dfs.c:62:3: warning: (near initialization for 'df= s_oper')
    [exec] fuse_dfs.c: In function 'main':
  =   [exec] fuse_dfs.c:132:3: warning: implicit declaration of function '= fuse_main'
    [exec] make[1]: *** [fuse_dfs.o] Error 1
&nb= sp;   [exec] make: *** [all-recursive] Error 1

BUILD FAILED
= /home/stuti/Installer/hadoop-0.20.2/build.xml:497: The following error occu= rred while executing this line:
/home/stuti/Installer/hadoop-0.20.2/src/= contrib/build.xml:30: The following error occurred while executing this lin= e:
/home/stuti/Installer/hadoop-0.20.2/src/contrib/fuse-dfs/build.xml:57= : exec returned: 2

-Stuti

::DISCLAIMER::
-----------------= ---------------------------------------------------------------------------= ---------------------------

The contents of this e-mail and any atta= chment(s) are confidential and intended for the named recipient(s) only.It shall not attach any liability on the originator or HCL or its affiliat= es. Any views or opinions presented in this email are solely those of the a= uthor and may not necessarily reflect the opinions of HCL or its affiliates= .
Any form of reproduction, dissemination, copying, disclosure, modifica= tion, distribution and / or publication of this message without the prior w= ritten consent of the author of this e-mail is strictly prohibited. If you = have received this email in error please delete it and notify the sender im= mediately. Before opening any mail and attachments please check them for vi= ruses and defect.

--------------------------------------------------= ---------------------------------------------------------------------


 
--
Alexander Lorenz
http://mapredit.blogspot.com
 P Think of the environment: please don't print this email unless you = really need to.
 
 




--
Alexander Lore= nz
http://map= redit.blogspot.com

P Think of the environment: please don't= print this email unless you really need to.

 

= --_000_7D9AF4B98807C54EBADEA75DF6D5ACB7E32FF984NDAHCLCEVS04HCL_--