Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3F978118F4 for ; Thu, 17 Jul 2014 23:56:57 +0000 (UTC) Received: (qmail 54898 invoked by uid 500); 17 Jul 2014 23:56:50 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 54793 invoked by uid 500); 17 Jul 2014 23:56:49 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 54609 invoked by uid 99); 17 Jul 2014 23:56:49 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 23:56:49 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of chris.mawata@gmail.com designates 209.85.220.174 as permitted sender) Received: from [209.85.220.174] (HELO mail-vc0-f174.google.com) (209.85.220.174) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 23:56:44 +0000 Received: by mail-vc0-f174.google.com with SMTP id la4so5979416vcb.5 for ; Thu, 17 Jul 2014 16:56:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=mCqHBChYvjsAwBiFiJk5I+FcOvk83L6TcU/j6WnerS4=; b=kUrStPcGsxx/4hoKHUAL54JRHhtD1Hsxx46de6R76eHGc/tnVdN+055M3L/hsgAYXO tzNfQbdI4oLQDiDeirhPvSQFil67dMGwVBntZupCKOGImw3Rs9V+gs287JXxEkUCfs2/ yUTiZZJpmtD5WXcIAxICYrqyov2AJo1t59GFFxglfKeZGydlQkIsET4PWMJV9vqlhsTG EMI3RUChe8vrTvEyO+QBC0mJ6wLj9wuWE/77d1SQL1zYrDi++B3Gp9dywbcSSSZ5+LHh co9hK8lCadjx7M8qcHQOkwZwzHizJHijBiD7JpYwc3HHAUSoGt0OwtgrN5lLlekAt1uM HCBg== MIME-Version: 1.0 X-Received: by 10.52.245.99 with SMTP id xn3mr425533vdc.85.1405641384221; Thu, 17 Jul 2014 16:56:24 -0700 (PDT) Received: by 10.221.38.196 with HTTP; Thu, 17 Jul 2014 16:56:24 -0700 (PDT) Received: by 10.221.38.196 with HTTP; Thu, 17 Jul 2014 16:56:24 -0700 (PDT) In-Reply-To: References: Date: Thu, 17 Jul 2014 19:56:24 -0400 Message-ID: Subject: Re: HDFS input/output error - fuse mount From: Chris Mawata To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c24b866363e104fe6c6308 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c24b866363e104fe6c6308 Content-Type: text/plain; charset=UTF-8 Version 51 ia Java 7 Chris On Jul 17, 2014 7:50 PM, "andrew touchet" wrote: > Hello, > > Hadoop package installed: > hadoop-0.20-0.20.2+737-33.osg.el5.noarch > > Operating System: > CentOS release 5.8 (Final) > > I am mounting HDFS from my namenode to another node with fuse. After > mounting to /hdfs, any attempts to 'ls', 'cd', or use 'hadoop fs' leads to > the below output. > > > $ls /hdfs > *ls: /hdfs: Input/output error* > $hadoop fs -ls > > > > > > > > > > > > > > *Exception in thread "main" java.lang.UnsupportedClassVersionError: > org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.0 at > java.lang.ClassLoader.defineClass1(Native Method) at > java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at > java.lang.ClassLoader.defineClass(ClassLoader.java:615) at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at > java.net.URLClassLoader.access$000(URLClassLoader.java:58) at > java.net.URLClassLoader$1.run(URLClassLoader.java:197) at > java.security.AccessController.doPrivileged(Native Method) at > java.net.URLClassLoader.findClass(URLClassLoader.java:190) at > java.lang.ClassLoader.loadClass(ClassLoader.java:306) at > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at > java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the > main class: org.apache.hadoop.fs.FsShell. Program will exit.* > > > I have attempted to mount /hdfs manually in debug mode and then attempted > to access /hdfs from a different terminal. This is the output. The namenode > is *glados*. The server where /hdfs is being mounted is *glados2*. > > > $hdfs -oserver=glados,port=9000,rdbuffer=131072,allow_other /hdfs -d > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > *fuse-dfs ignoring option allow_otherERROR fuse_options.c:162 fuse-dfs > didn't recognize /hdfs,-2fuse-dfs ignoring option -d unique: 1, opcode: > INIT (26), nodeid: 0, insize: 56INIT: > 7.10flags=0x0000000bmax_readahead=0x00020000INFO fuse_init.c:115 Mounting > glados:9000Exception in thread "main" > java.lang.UnsupportedClassVersionError: > org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 > at java.lang.ClassLoader.defineClass1(Native Method) at > java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at > java.lang.ClassLoader.defineClass(ClassLoader.java:615) at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at > java.net.URLClassLoader.access$000(URLClassLoader.java:58) at > java.net.URLClassLoader$1.run(URLClassLoader.java:197) at > java.security.AccessController.doPrivileged(Native Method) at > java.net.URLClassLoader.findClass(URLClassLoader.java:190) at > java.lang.ClassLoader.loadClass(ClassLoader.java:306) at > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at > java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct > instance of class org.apache.hadoop.conf.ConfigurationERROR fuse_init.c:127 > Unable to establish test connection to server INIT: 7.8 > flags=0x00000001 max_readahead=0x00020000 max_write=0x00020000 > unique: 1, error: 0 (Success), outsize: 40unique: 2, opcode: GETATTR (3), > nodeid: 1, insize: 56Exception in thread "Thread-0" > java.lang.UnsupportedClassVersionError: > org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 > at java.lang.ClassLoader.defineClass1(Native Method) at > java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at > java.lang.ClassLoader.defineClass(ClassLoader.java:615) at > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at > java.net.URLClassLoader.access$000(URLClassLoader.java:58) at > java.net.URLClassLoader$1.run(URLClassLoader.java:197) at > java.security.AccessController.doPrivileged(Native Method) at > java.net.URLClassLoader.findClass(URLClassLoader.java:190) at > java.lang.ClassLoader.loadClass(ClassLoader.java:306) at > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at > java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct > instance of class org.apache.hadoop.conf.ConfigurationERROR > fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR > fuse_impls_getattr.c:40 Could not connect to glados:9000 unique: 2, > error: -5 (Input/output error), outsize: 16 unique: 3, opcode: GETATTR (3), > nodeid: 1, insize: 56* > > I adopted this system after this was already setup, so I do not know which > java version was used during install. Currently I'm using: > > $java -version > > > *java version "1.6.0_45"Java(TM) SE Runtime Environment (build > 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed > mode)* > > $java -version > > > > > > *java version "1.6.0_45" Java(TM) SE Runtime Environment (build > 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed > mode)* > Is my java version really the cause of this issue? What is the correct > java version to be used for this version of hadoop. I have also tried > 1.6.0_31 but no changes were seen. > > If java isn't my issue, then what is? > > Best regards, > > Andrew > > > > > --001a11c24b866363e104fe6c6308 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Version 51 ia Java 7
Chris

On Jul 17, 2014 7:50 PM, "andrew touchet&qu= ot; <adt027@latech.edu> wrot= e:
Hello,

Hadoop package installed= :
hadoop-0.20-0.20.2+737-33.osg.el5.noarch

Operating S= ystem:
CentOS release 5.8 (Final)

I am mounting = HDFS from my namenode to another node with fuse.=C2=A0 After mounting to /h= dfs, any attempts to 'ls', 'cd', or use 'hadoop fs'= leads to the below output.


$ls /hdfs
ls: /hdfs: Input/output error
$hadoop fs -ls=
Exception in thread "main" java.lang.UnsupportedClassVersi= onError: org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.= 0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.fs.FsShell.=C2=A0 Program = will exit.


I have attempted to mount /hdfs manually in= debug mode and then attempted to access /hdfs from a different terminal. T= his is the output. The namenode is glados. The server where /hdfs is= being mounted is glados2.


$hdfs -oserver=3Dglados,port=3D9000,rdbuffer=3D131072,allow_other /= hdfs -d
fuse-dfs ignoring option allow_other
ERROR fuse_options.c:= 162 fuse-dfs didn't recognize /hdfs,-2

fuse-dfs ignoring option = -d
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56
INIT: 7.10
flags= =3D0x0000000b
max_readahead=3D0x00020000
INFO fuse_init.c:115 Mountin= g glados:9000
Exception in thread "main" java.lang.Unsupported= ClassVersionError: org/apache/hadoop/conf/Configuration : Unsupported major= .minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_init.c:127 Unable to establish test connection to server
= =C2=A0=C2=A0 INIT: 7.8
=C2=A0=C2=A0 flags=3D0x00000001
=C2=A0=C2=A0 m= ax_readahead=3D0x00020000
=C2=A0=C2=A0 max_write=3D0x00020000
=C2=A0=C2=A0 unique: 1, error: 0 (Success), outsize: 40
unique: 2, opcod= e: GETATTR (3), nodeid: 1, insize: 56
Exception in thread "Thread-0= " java.lang.UnsupportedClassVersionError: org/apache/hadoop/conf/Confi= guration : Unsupported major.minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR fuse_impls_getattr.c:40 Could not connect to glados:9000
=C2=A0= =C2=A0 unique: 2, error: -5 (Input/output error), outsize: 16
unique: 3, opcode: GETATTR (3), nodeid: 1, insize: 56

I ad= opted this system after this was already setup, so I do not know which java= version was used during install. Currently I'm using:

$java -ve= rsion
java version "1.6.0_45"
Java(TM) SE Runtime Environment (bu= ild 1.6.0_45-b06)
Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mi= xed mode)

$java -version
java version "1.6.0_45"=
Java(TM) SE Runtime Environment (build 1.6.0_45-b06)
Java HotSpot(TM) 64= -Bit Server VM (build 20.45-b01, mixed mode)


Is m= y java version really the cause of this issue?=C2=A0 What is the correct ja= va version to be used for this version of hadoop.=C2=A0 I have also tried 1= .6.0_31 but no changes were seen.

If java isn't my issue, then what is?

= Best regards,

Andrew



--001a11c24b866363e104fe6c6308--