hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrew touchet <adt...@latech.edu>
Subject Re: HDFS input/output error - fuse mount
Date Fri, 18 Jul 2014 01:06:42 GMT
Hi Chris,

I tried to mount /hdfs with java versions below but there was no change in
output.
jre-7u21
jdk-7u21
jdk-7u55
jdk1.6.0_31
jdk1.6.0_45




On Thu, Jul 17, 2014 at 6:56 PM, Chris Mawata <chris.mawata@gmail.com>
wrote:

> Version 51 ia Java 7
> Chris
> On Jul 17, 2014 7:50 PM, "andrew touchet" <adt027@latech.edu> wrote:
>
>> Hello,
>>
>> Hadoop package installed:
>> hadoop-0.20-0.20.2+737-33.osg.el5.noarch
>>
>> Operating System:
>> CentOS release 5.8 (Final)
>>
>> I am mounting HDFS from my namenode to another node with fuse.  After
>> mounting to /hdfs, any attempts to 'ls', 'cd', or use 'hadoop fs' leads to
>> the below output.
>>
>>
>> $ls /hdfs
>> *ls: /hdfs: Input/output error*
>> $hadoop fs -ls
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *Exception in thread "main" java.lang.UnsupportedClassVersionError:
>> org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.0     at
>> java.lang.ClassLoader.defineClass1(Native Method)    at
>> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)    at
>> java.lang.ClassLoader.defineClass(ClassLoader.java:615)    at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)    at
>> java.net.URLClassLoader.access$000(URLClassLoader.java:58)    at
>> java.net.URLClassLoader$1.run(URLClassLoader.java:197)    at
>> java.security.AccessController.doPrivileged(Native Method)     at
>> java.net.URLClassLoader.findClass(URLClassLoader.java:190)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:306)    at
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the
>> main class: org.apache.hadoop.fs.FsShell.  Program will exit.*
>>
>>
>> I have attempted to mount /hdfs manually in debug mode and then attempted
>> to access /hdfs from a different terminal. This is the output. The namenode
>> is *glados*. The server where /hdfs is being mounted is *glados2*.
>>
>>
>> $hdfs -oserver=glados,port=9000,rdbuffer=131072,allow_other /hdfs -d
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> *fuse-dfs ignoring option allow_otherERROR fuse_options.c:162 fuse-dfs
>> didn't recognize /hdfs,-2fuse-dfs ignoring option -d unique: 1, opcode:
>> INIT (26), nodeid: 0, insize: 56INIT:
>> 7.10flags=0x0000000bmax_readahead=0x00020000INFO fuse_init.c:115 Mounting
>> glados:9000Exception in thread "main"
>> java.lang.UnsupportedClassVersionError:
>> org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0
>>     at java.lang.ClassLoader.defineClass1(Native Method)    at
>> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)    at
>> java.lang.ClassLoader.defineClass(ClassLoader.java:615)    at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)    at
>> java.net.URLClassLoader.access$000(URLClassLoader.java:58)    at
>> java.net.URLClassLoader$1.run(URLClassLoader.java:197)    at
>> java.security.AccessController.doPrivileged(Native Method)     at
>> java.net.URLClassLoader.findClass(URLClassLoader.java:190)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:306)    at
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct
>> instance of class org.apache.hadoop.conf.ConfigurationERROR fuse_init.c:127
>> Unable to establish test connection to server   INIT: 7.8
>> flags=0x00000001   max_readahead=0x00020000   max_write=0x00020000
>> unique: 1, error: 0 (Success), outsize: 40unique: 2, opcode: GETATTR (3),
>> nodeid: 1, insize: 56Exception in thread "Thread-0"
>> java.lang.UnsupportedClassVersionError:
>> org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0
>>     at java.lang.ClassLoader.defineClass1(Native Method)    at
>> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)    at
>> java.lang.ClassLoader.defineClass(ClassLoader.java:615)    at
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)    at
>> java.net.URLClassLoader.access$000(URLClassLoader.java:58)    at
>> java.net.URLClassLoader$1.run(URLClassLoader.java:197)    at
>> java.security.AccessController.doPrivileged(Native Method)     at
>> java.net.URLClassLoader.findClass(URLClassLoader.java:190)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:306)    at
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)    at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct
>> instance of class org.apache.hadoop.conf.ConfigurationERROR
>> fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR
>> fuse_impls_getattr.c:40 Could not connect to glados:9000   unique: 2,
>> error: -5 (Input/output error), outsize: 16 unique: 3, opcode: GETATTR (3),
>> nodeid: 1, insize: 56*
>>
>> I adopted this system after this was already setup, so I do not know
>> which java version was used during install. Currently I'm using:
>>
>> $java -version
>>
>>
>> *java version "1.6.0_45"Java(TM) SE Runtime Environment (build
>> 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed
>> mode)*
>>
>> $java -version
>>
>>
>>
>>
>>
>> *java version "1.6.0_45" Java(TM) SE Runtime Environment (build
>> 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed
>> mode)*
>> Is my java version really the cause of this issue?  What is the correct
>> java version to be used for this version of hadoop.  I have also tried
>> 1.6.0_31 but no changes were seen.
>>
>> If java isn't my issue, then what is?
>>
>> Best regards,
>>
>> Andrew
>>
>>
>>
>>
>>

Mime
View raw message