Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 39E0511B14 for ; Fri, 18 Jul 2014 01:07:25 +0000 (UTC) Received: (qmail 97116 invoked by uid 500); 18 Jul 2014 01:07:20 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 97008 invoked by uid 500); 18 Jul 2014 01:07:20 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 96998 invoked by uid 99); 18 Jul 2014 01:07:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Jul 2014 01:07:19 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of adt027@latech.edu designates 138.47.18.62 as permitted sender) Received: from [138.47.18.62] (HELO smtp.LaTech.edu) (138.47.18.62) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Jul 2014 01:07:14 +0000 Received: from smtp (localhost [127.0.0.1]) by smtp.LaTech.edu (Postfix) with ESMTP id ABE8251058 for ; Thu, 17 Jul 2014 20:06:51 -0500 (CDT) X-Virus-Scanned: amavisd-new at latech.edu Received: from smtp.LaTech.edu ([127.0.0.1]) by smtp (smtp.latech.edu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id D8ZSRU1bJHsr for ; Thu, 17 Jul 2014 20:06:44 -0500 (CDT) Received: from smtp.LaTech.edu (localhost [127.0.0.1]) by smtp.LaTech.edu (Postfix) with ESMTP id 3E9E451061 for ; Thu, 17 Jul 2014 20:06:44 -0500 (CDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=latech.edu; h=mime-version :in-reply-to:references:date:message-id:subject:from:to :content-type; s=latech; bh=/D32qzq8CFiIjoJs58YEoW5mKxo=; b=Bhu9 9u2kX6EaeC15ni06N8aoThMTO3R479V0JCX5U31/k57WYTwTFS8S4TrxZgZK12Hv qMCrzyEBpAGZwfOAwQE9r1fTud6p7qPQmUsztXI3efiO2Z2UpdCSPjbCetZ5nRzi fcVy8ZQx0IpgVuMrOk7Q4Y/BDEeO/XeQv4RHQzo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=latech.edu; h=mime-version :in-reply-to:references:date:message-id:subject:from:to :content-type; q=dns; s=latech; b=Nu4i/e8ZMuAqhWFqXXOOKt9bynfeD4 F+s6OGgZGZayUrxoF2Jc+xKru+Ys1mQlcpcF//g6aBtnKiljzePg392nnQitUuBW 7xR1SHszPJlE5IZdR0mRWbj/sDJY4vYNUByhTncjm1rlEQxIpiGoWQnjsGch7LMe XHP2QxYZJqVx0= Received: from mail-we0-f175.google.com (mail-we0-f175.google.com [74.125.82.175]) by smtp.LaTech.edu (Postfix) with ESMTPSA id C75975105E for ; Thu, 17 Jul 2014 20:06:43 -0500 (CDT) Received: by mail-we0-f175.google.com with SMTP id t60so3909862wes.20 for ; Thu, 17 Jul 2014 18:06:42 -0700 (PDT) MIME-Version: 1.0 X-Received: by 10.180.205.138 with SMTP id lg10mr2443925wic.49.1405645602267; Thu, 17 Jul 2014 18:06:42 -0700 (PDT) Received: by 10.217.152.71 with HTTP; Thu, 17 Jul 2014 18:06:42 -0700 (PDT) In-Reply-To: References: Date: Thu, 17 Jul 2014 20:06:42 -0500 Message-ID: Subject: Re: HDFS input/output error - fuse mount From: andrew touchet To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c38594cdaa6d04fe6d5eb1 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c38594cdaa6d04fe6d5eb1 Content-Type: text/plain; charset=UTF-8 Hi Chris, I tried to mount /hdfs with java versions below but there was no change in output. jre-7u21 jdk-7u21 jdk-7u55 jdk1.6.0_31 jdk1.6.0_45 On Thu, Jul 17, 2014 at 6:56 PM, Chris Mawata wrote: > Version 51 ia Java 7 > Chris > On Jul 17, 2014 7:50 PM, "andrew touchet" wrote: > >> Hello, >> >> Hadoop package installed: >> hadoop-0.20-0.20.2+737-33.osg.el5.noarch >> >> Operating System: >> CentOS release 5.8 (Final) >> >> I am mounting HDFS from my namenode to another node with fuse. After >> mounting to /hdfs, any attempts to 'ls', 'cd', or use 'hadoop fs' leads to >> the below output. >> >> >> $ls /hdfs >> *ls: /hdfs: Input/output error* >> $hadoop fs -ls >> >> >> >> >> >> >> >> >> >> >> >> >> >> *Exception in thread "main" java.lang.UnsupportedClassVersionError: >> org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.0 at >> java.lang.ClassLoader.defineClass1(Native Method) at >> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at >> java.lang.ClassLoader.defineClass(ClassLoader.java:615) at >> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at >> java.net.URLClassLoader.access$000(URLClassLoader.java:58) at >> java.net.URLClassLoader$1.run(URLClassLoader.java:197) at >> java.security.AccessController.doPrivileged(Native Method) at >> java.net.URLClassLoader.findClass(URLClassLoader.java:190) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:306) at >> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the >> main class: org.apache.hadoop.fs.FsShell. Program will exit.* >> >> >> I have attempted to mount /hdfs manually in debug mode and then attempted >> to access /hdfs from a different terminal. This is the output. The namenode >> is *glados*. The server where /hdfs is being mounted is *glados2*. >> >> >> $hdfs -oserver=glados,port=9000,rdbuffer=131072,allow_other /hdfs -d >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> *fuse-dfs ignoring option allow_otherERROR fuse_options.c:162 fuse-dfs >> didn't recognize /hdfs,-2fuse-dfs ignoring option -d unique: 1, opcode: >> INIT (26), nodeid: 0, insize: 56INIT: >> 7.10flags=0x0000000bmax_readahead=0x00020000INFO fuse_init.c:115 Mounting >> glados:9000Exception in thread "main" >> java.lang.UnsupportedClassVersionError: >> org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 >> at java.lang.ClassLoader.defineClass1(Native Method) at >> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at >> java.lang.ClassLoader.defineClass(ClassLoader.java:615) at >> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at >> java.net.URLClassLoader.access$000(URLClassLoader.java:58) at >> java.net.URLClassLoader$1.run(URLClassLoader.java:197) at >> java.security.AccessController.doPrivileged(Native Method) at >> java.net.URLClassLoader.findClass(URLClassLoader.java:190) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:306) at >> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct >> instance of class org.apache.hadoop.conf.ConfigurationERROR fuse_init.c:127 >> Unable to establish test connection to server INIT: 7.8 >> flags=0x00000001 max_readahead=0x00020000 max_write=0x00020000 >> unique: 1, error: 0 (Success), outsize: 40unique: 2, opcode: GETATTR (3), >> nodeid: 1, insize: 56Exception in thread "Thread-0" >> java.lang.UnsupportedClassVersionError: >> org/apache/hadoop/conf/Configuration : Unsupported major.minor version 51.0 >> at java.lang.ClassLoader.defineClass1(Native Method) at >> java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at >> java.lang.ClassLoader.defineClass(ClassLoader.java:615) at >> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at >> java.net.URLClassLoader.access$000(URLClassLoader.java:58) at >> java.net.URLClassLoader$1.run(URLClassLoader.java:197) at >> java.security.AccessController.doPrivileged(Native Method) at >> java.net.URLClassLoader.findClass(URLClassLoader.java:190) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:306) at >> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at >> java.lang.ClassLoader.loadClass(ClassLoader.java:247) Can't construct >> instance of class org.apache.hadoop.conf.ConfigurationERROR >> fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR >> fuse_impls_getattr.c:40 Could not connect to glados:9000 unique: 2, >> error: -5 (Input/output error), outsize: 16 unique: 3, opcode: GETATTR (3), >> nodeid: 1, insize: 56* >> >> I adopted this system after this was already setup, so I do not know >> which java version was used during install. Currently I'm using: >> >> $java -version >> >> >> *java version "1.6.0_45"Java(TM) SE Runtime Environment (build >> 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed >> mode)* >> >> $java -version >> >> >> >> >> >> *java version "1.6.0_45" Java(TM) SE Runtime Environment (build >> 1.6.0_45-b06)Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mixed >> mode)* >> Is my java version really the cause of this issue? What is the correct >> java version to be used for this version of hadoop. I have also tried >> 1.6.0_31 but no changes were seen. >> >> If java isn't my issue, then what is? >> >> Best regards, >> >> Andrew >> >> >> >> >> --001a11c38594cdaa6d04fe6d5eb1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Chris,

I tried to mount /h= dfs with java versions below but there was no change in output.=C2=A0
<= /div>jre-7u21
jdk-7u21
jdk-7u55
jdk1.6.0_31
jdk1.6.0= _45




On Thu, Jul 17, 2014 at 6:56 PM, Chris Mawata <= chris.mawata@gm= ail.com> wrote:

Version 51 ia Java 7
Chris

On Jul 17, 2014 7:50 PM, "andrew touchet&qu= ot; <adt027@latec= h.edu> wrote:
Hello,

Hadoop package installed= :
hadoop-0.20-0.20.2+737-33.osg.el5.noarch

Operating S= ystem:
CentOS release 5.8 (Final)

I am mounting = HDFS from my namenode to another node with fuse.=C2=A0 After mounting to /h= dfs, any attempts to 'ls', 'cd', or use 'hadoop fs'= leads to the below output.


$ls /hdfs
ls: /hdfs: Input/output error
$hadoop fs -ls=
Exception in thread "main" java.lang.UnsupportedClassVersi= onError: org/apache/hadoop/fs/FsShell : Unsupported major.minor version 51.= 0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.fs.FsShell.=C2=A0 Program = will exit.


I have attempted to mount /hdfs manually in= debug mode and then attempted to access /hdfs from a different terminal. T= his is the output. The namenode is glados. The server where /hdfs is= being mounted is glados2.


$hdfs -oserver=3Dglados,port=3D9000,rdbuffer=3D131072,allow_other /= hdfs -d
fuse-dfs ignoring option allow_other
ERROR fuse_options.c:= 162 fuse-dfs didn't recognize /hdfs,-2

fuse-dfs ignoring option = -d
unique: 1, opcode: INIT (26), nodeid: 0, insize: 56
INIT: 7.10
flags= =3D0x0000000b
max_readahead=3D0x00020000
INFO fuse_init.c:115 Mountin= g glados:9000
Exception in thread "main" java.lang.Unsupported= ClassVersionError: org/apache/hadoop/conf/Configuration : Unsupported major= .minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_init.c:127 Unable to establish test connection to server
= =C2=A0=C2=A0 INIT: 7.8
=C2=A0=C2=A0 flags=3D0x00000001
=C2=A0=C2=A0 m= ax_readahead=3D0x00020000
=C2=A0=C2=A0 max_write=3D0x00020000
=C2=A0=C2=A0 unique: 1, error: 0 (Success), outsize: 40
unique: 2, opcod= e: GETATTR (3), nodeid: 1, insize: 56
Exception in thread "Thread-0= " java.lang.UnsupportedClassVersionError: org/apache/hadoop/conf/Confi= guration : Unsupported major.minor version 51.0
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass1(Native Method)
= =C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClassCond(ClassLoader.jav= a:631)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.defineClass(ClassLoad= er.java:615)
=C2=A0=C2=A0=C2=A0 at java.security.SecureClassLoader.defin= eClass(SecureClassLoader.java:141)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.defineClass(URLClassLoader.ja= va:283)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.access$000(URLClas= sLoader.java:58)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader$1.run(URL= ClassLoader.java:197)
=C2=A0=C2=A0=C2=A0 at java.security.AccessControll= er.doPrivileged(Native Method)
=C2=A0=C2=A0=C2=A0 at java.net.URLClassLoader.findClass(URLClassLoader.java= :190)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadClass(ClassLoader.= java:306)
=C2=A0=C2=A0=C2=A0 at sun.misc.Launcher$AppClassLoader.loadCla= ss(Launcher.java:301)
=C2=A0=C2=A0=C2=A0 at java.lang.ClassLoader.loadCl= ass(ClassLoader.java:247)
Can't construct instance of class org.apache.hadoop.conf.Configuration<= br>ERROR fuse_connect.c:83 Unable to instantiate a filesystem for user027ERROR fuse_impls_getattr.c:40 Could not connect to glados:9000
=C2=A0= =C2=A0 unique: 2, error: -5 (Input/output error), outsize: 16
unique: 3, opcode: GETATTR (3), nodeid: 1, insize: 56

I ad= opted this system after this was already setup, so I do not know which java= version was used during install. Currently I'm using:

$java -ve= rsion
java version "1.6.0_45"
Java(TM) SE Runtime Environment (bu= ild 1.6.0_45-b06)
Java HotSpot(TM) 64-Bit Server VM (build 20.45-b01, mi= xed mode)

$java -version
java version "1.6.0_45"=
Java(TM) SE Runtime Environment (build 1.6.0_45-b06)
Java HotSpot(TM) 64= -Bit Server VM (build 20.45-b01, mixed mode)


Is m= y java version really the cause of this issue?=C2=A0 What is the correct ja= va version to be used for this version of hadoop.=C2=A0 I have also tried 1= .6.0_31 but no changes were seen.

If java isn't my issue, then what is?

= Best regards,

Andrew




--001a11c38594cdaa6d04fe6d5eb1--