Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 71082118D7 for ; Thu, 17 Jul 2014 23:50:31 +0000 (UTC) Received: (qmail 42871 invoked by uid 500); 17 Jul 2014 23:50:26 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 42755 invoked by uid 500); 17 Jul 2014 23:50:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 42745 invoked by uid 99); 17 Jul 2014 23:50:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 23:50:26 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of adt027@latech.edu designates 138.47.18.140 as permitted sender) Received: from [138.47.18.140] (HELO smtp.LaTech.edu) (138.47.18.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 23:50:23 +0000 Received: from smtp (localhost [127.0.0.1]) by smtp.LaTech.edu (Postfix) with ESMTP id 0A72F510A2 for ; Thu, 17 Jul 2014 18:49:58 -0500 (CDT) X-Virus-Scanned: amavisd-new at latech.edu Received: from smtp.LaTech.edu ([127.0.0.1]) by smtp (smtp.latech.edu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id HPsF253ibNe3 for ; Thu, 17 Jul 2014 18:49:54 -0500 (CDT) Received: from smtp.LaTech.edu (localhost [127.0.0.1]) by smtp.LaTech.edu (Postfix) with ESMTP id B9E6C51088 for ; Thu, 17 Jul 2014 18:49:53 -0500 (CDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=latech.edu; h=mime-version :date:message-id:subject:from:to:content-type; s=latech; bh=Ek73 Y6c9G5FXwbg6TSycaGF0SaM=; b=qkntqQoCOa8hYSZ9+JM1zh7IhsU5YyXQO2hV AB1ubZzFjyjr697Em9KWlDW1t7O6X8AJCvPuogQqMLRUZJsPpT60i42olLPL5ve8 8ilschTA+Tpe4J/0ZGwxC9HX/8ayvsYDm5hgMibiFSYYrTBAlWpIa8aIOLBpBezu QsiHbd4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=latech.edu; h=mime-version :date:message-id:subject:from:to:content-type; q=dns; s=latech; b= PEFznb5RIHC4NHHG5wOhE77h+DmHJwa46lEXnAKNBW9Ubx3fo/5BhyWqjK5E/tS5 QlSWIas1iVS+oj4k6y58vIY6EgqPHwQhnyLrkoQeD0paIpF55XYsfNGqu0w6FPVJ IdYnSOboJNB9DCGif2njfBp7BWdmRtxwaWjGZJASeJI= Received: from mail-wg0-f41.google.com (mail-wg0-f41.google.com [74.125.82.41]) by smtp.LaTech.edu (Postfix) with ESMTPSA id 4B45651062 for ; Thu, 17 Jul 2014 18:49:53 -0500 (CDT) Received: by mail-wg0-f41.google.com with SMTP id z12so2802731wgg.24 for ; Thu, 17 Jul 2014 16:49:51 -0700 (PDT) MIME-Version: 1.0 X-Received: by 10.194.63.196 with SMTP id i4mr1088960wjs.50.1405640991954; Thu, 17 Jul 2014 16:49:51 -0700 (PDT) Received: by 10.217.152.71 with HTTP; Thu, 17 Jul 2014 16:49:51 -0700 (PDT) Date: Thu, 17 Jul 2014 18:49:51 -0500 Message-ID: Subject: HDFS input/output error - fuse mount From: andrew touchet To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b86dd0001df7004fe6c4cc7 X-Virus-Checked: Checked by ClamAV on apache.org --047d7b86dd0001df7004fe6c4cc7 Content-Type: text/plain; charset=UTF-8 Hello, Hadoop package installed: hadoop-0.20-0.20.2+737-33.osg.el5.noarch Operating System: CentOS release 5.8 (Final) I am mounting HDFS from my namenode to another node with fuse. After mounting to /hdfs, any attempts to 'ls', 'cd', or use 'hadoop fs' leads to the below output. $ls /hdfs *ls: /hdfs: Input/output error* $hadoop fs -ls *Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247)Could not find the main class: org.apache.hadoop.fs.FsShell. Program will exit.* I have attempted to mount /hdfs manually in debug mode and then attempted to access /hdfs from a different terminal. This is the output. The namenode is *glados*. The server where /hdfs is being mounted is *glados2*. $hdfs -oserver=glados,port=9000,rdbuffer=131072,allow_other /hdfs -d *fuse-dfs ignoring option allow_otherERROR fuse_options.c:162 fuse-dfs didn't recognize /hdfs,-2fuse-dfs ignoring option -dunique: 1, opcode: INIT (26), nodeid: 0, insize: 56INIT: 7.10flags=0x0000000bmax_readahead=0x00020000INFO fuse_init.c:115 Mounting glados:9000Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247)Can't construct instance of class org.apache.hadoop.conf.ConfigurationERROR fuse_init.c:127 Unable to establish test connection to server INIT: 7.8 flags=0x00000001 max_readahead=0x00020000 max_write=0x00020000 unique: 1, error: 0 (Success), outsize: 40unique: 2, opcode: GETATTR (3), nodeid: 1, insize: 56Exception in thread "Thread-0" java.lang.UnsupportedClassVersionError: org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247)Can't construct instance of class org.apache.hadoop.conf.ConfigurationERROR fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR fuse_impls_getattr.c:40 Could not connect to glados:9000 unique: 2, error: -5 (Input/output error), outsize: 16unique: 3, opcode: GETATTR (3), nodeid: 1, insize: 56* I adopted this system after this was already setup, so I do not know which java version was used during install. Currently I'm using: $java -version *java version "1.6.0_45"Java(TM) SE Runtime Environment (build 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed mode)* $java -version *java version "1.6.0_45"Java(TM) SE Runtime Environment (build 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed mode)* Is my java version really the cause of this issue? What is the correct java version to be used for this version of hadoop. I have also tried 1.6.0_31 but no changes were seen. If java isn't my issue, then what is? Best regards, Andrew --047d7b86dd0001df7004fe6c4cc7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello,

Hadoop package installed= :
hadoop-0.20-0.20.2+737-33.osg.el5.noarch

Operating S= ystem:
CentOS release 5.8 (Final)

I am mounting = HDFS from my namenode to another node with fuse.=C2=A0 After mounting to /h= dfs, any attempts to 'ls', 'cd', or use 'hadoop fs'= leads to the below output.


$ls /hdfs
ls: /hdfs: Input/output error
$hadoop fs -ls=
Exception in thread "main" java.lang.UnsupportedClassVersi= onError: org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.= 0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.fs.FsShell.=C2=A0 Program = will exit.


I have attempted to mount /hdfs manually in= debug mode and then attempted to access /hdfs from a different terminal. T= his is the output. The namenode is glados. The server where /hdfs is= being mounted is glados2.


$hdfs -oserver=3Dglados,port=3D9000,rdbuffer=3D131072,allow_other /= hdfs -d
fuse-dfs ignoring option allow_other
ERROR fuse_options.c:= 162 fuse-dfs didn't recognize /hdfs,-2

fuse-dfs ignoring option = -d
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56
INIT: 7.10
flags= =3D0x0000000b
max_readahead=3D0x00020000
INFO fuse_init.c:115 Mountin= g glados:9000
Exception in thread "main" java.lang.Unsupported= ClassVersionError: org/apache/hadoop/conf/Configuration : Unsupported major= .minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_init.c:127 Unable to establish test connection to server
= =C2=A0=C2=A0 INIT: 7.8
=C2=A0=C2=A0 flags=3D0x00000001
=C2=A0=C2=A0 m= ax_readahead=3D0x00020000
=C2=A0=C2=A0 max_write=3D0x00020000
=C2=A0=C2=A0 unique: 1, error: 0 (Success), outsize: 40
unique: 2, opcod= e: GETATTR (3), nodeid: 1, insize: 56
Exception in thread "Thread-0= " java.lang.UnsupportedClassVersionError: org/apache/hadoop/conf/Confi= guration : Unsupported major.minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR fuse_impls_getattr.c:40 Could not connect to glados:9000
=C2=A0= =C2=A0 unique: 2, error: -5 (Input/output error), outsize: 16
unique: 3, opcode: GETATTR (3), nodeid: 1, insize: 56

I ad= opted this system after this was already setup, so I do not know which java= version was used during install. Currently I'm using:

$java -ve= rsion
java version "1.6.0_45"
Java(TM) SE Runtime Environment (bu= ild 1.6.0_45-b06)
Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mi= xed mode)

$java -version
java version "1.6.0_45"=
Java(TM) SE Runtime Environment (build 1.6.0_45-b06)
Java HotSpot(TM) 64= -Bit Server VM (build 20.45-b01, mixed mode)


Is m= y java version really the cause of this issue?=C2=A0 What is the correct ja= va version to be used for this version of hadoop.=C2=A0 I have also tried 1= .6.0_31 but no changes were seen.

If java isn't my issue, then what is?

= Best regards,

Andrew



--047d7b86dd0001df7004fe6c4cc7--