hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars George (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HBASE-4467) Handle inconsistencies in Hadoop libraries naming in hbase script
Date Fri, 23 Sep 2011 13:13:29 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13113406#comment-13113406
] 

Lars George edited comment on HBASE-4467 at 9/23/11 1:13 PM:
-------------------------------------------------------------

So the issue is this:

{noformat}
function append_path() {
  if [ -z "$1" ]; then
    echo $2
  else
    echo $1:$2
  fi
}

in combination with 

{noformat}
 HADOOPCPPATH=$(append_path "${HADOOPCPPATH}" `ls ${HADOOP_HOME}/hadoop-*.jar`)
{noformat}

This "ls" emits multiple values and that screws up the classpath. This either needs a "sed"
or a loop outside of the "append_path" call iterating over all dir entries and adding them
one by one.

      was (Author: larsgeorge):
    So the issue is this:
  
> Handle inconsistencies in Hadoop libraries naming in hbase script
> -----------------------------------------------------------------
>
>                 Key: HBASE-4467
>                 URL: https://issues.apache.org/jira/browse/HBASE-4467
>             Project: HBase
>          Issue Type: Bug
>          Components: scripts
>            Reporter: Lars George
>            Priority: Trivial
>
> When using an Hadoop tarball that has a library naming of "hadoop-x.y.z-core" as opposed
to "hadoop-core-x.y.z" then the hbase script throws errors.
> {noformat}
> $ bin/start-hbase.sh 
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> localhost: starting zookeeper, logging to /projects/opensource/hbase-trunk-rw//logs/hbase-larsgeorge-zookeeper-de1-app-mbp-2.out
> localhost: /projects/opensource/hadoop-0.20.2-append
> localhost: ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file
or directory
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> localhost: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> localhost: 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> localhost: 	at java.security.AccessController.doPrivileged(Native Method)
> localhost: 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> localhost: 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> localhost: 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> localhost: 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> starting master, logging to /projects/opensource/hbase-trunk-rw/bin/../logs/hbase-larsgeorge-master-de1-app-mbp-2.out
> /projects/opensource/hadoop-0.20.2-append
> ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file or directory
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> localhost: starting regionserver, logging to /projects/opensource/hbase-trunk-rw//logs/hbase-larsgeorge-regionserver-de1-app-mbp-2.out
> localhost: /projects/opensource/hadoop-0.20.2-append
> localhost: ls: /projects/opensource/hadoop-0.20.2-append/hadoop-core*.jar: No such file
or directory
> localhost: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName
> localhost: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
> localhost: 	at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> localhost: 	at java.security.AccessController.doPrivileged(Native Method)
> localhost: 	at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> localhost: 	at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> localhost: 	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> localhost: 	at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> {noformat}
> The naming in this case:
> {noformat}
> $ ll /projects/opensource/hadoop-0.20.2-append/
> total 14960
> drwxr-xr-x@  26 larsgeorge  staff      884 Apr 13 09:09 .
> drwxr-xr-x  114 larsgeorge  staff     3876 Sep 22 19:42 ..
> -rw-r--r--@   1 larsgeorge  staff   348624 Apr 13 08:58 CHANGES.txt
> -rw-r--r--@   1 larsgeorge  staff    13366 Apr 13 08:58 LICENSE.txt
> -rw-r--r--@   1 larsgeorge  staff      101 Apr 13 08:58 NOTICE.txt
> -rw-r--r--@   1 larsgeorge  staff     1366 Apr 13 08:58 README.txt
> drwxr-xr-x@  17 larsgeorge  staff      578 Apr 13 08:58 bin
> -rw-r--r--@   1 larsgeorge  staff    74035 Apr 13 08:58 build.xml
> drwxr-xr-x@   4 larsgeorge  staff      136 Apr 13 08:58 c++
> drwxr-xr-x   18 larsgeorge  staff      612 Aug  9 15:11 conf
> drwxr-xr-x@  15 larsgeorge  staff      510 Apr 13 08:58 conf.original
> drwxr-xr-x@  13 larsgeorge  staff      442 Apr 13 08:58 contrib
> drwxr-xr-x@  63 larsgeorge  staff     2142 Apr 13 08:58 docs
> -rw-r--r--@   1 larsgeorge  staff     6839 Apr 13 08:58 hadoop-0.20.2-ant.jar
> -rw-r--r--    1 larsgeorge  staff  2707920 Apr 13 09:06 hadoop-0.20.2-core.jar
> -rw-r--r--@   1 larsgeorge  staff  2689741 Apr 13 08:58 hadoop-0.20.2-core.jar.original
> -rw-r--r--@   1 larsgeorge  staff   142466 Apr 13 08:58 hadoop-0.20.2-examples.jar
> -rw-r--r--@   1 larsgeorge  staff  1563859 Apr 13 08:58 hadoop-0.20.2-test.jar
> -rw-r--r--@   1 larsgeorge  staff    69940 Apr 13 08:58 hadoop-0.20.2-tools.jar
> drwxr-xr-x@   6 larsgeorge  staff      204 Apr 13 08:58 ivy
> -rw-r--r--@   1 larsgeorge  staff     8852 Apr 13 08:58 ivy.xml
> drwxr-xr-x@  30 larsgeorge  staff     1020 Jul 13 10:20 lib
> drwxr-xr-x@   3 larsgeorge  staff      102 Apr 13 08:58 librecordio
> drwxr-xr-x    3 larsgeorge  staff      102 May 16 09:56 logs
> drwxr-xr-x@  17 larsgeorge  staff      578 Apr 13 08:58 src
> drwxr-xr-x@   8 larsgeorge  staff      272 Apr 13 08:58 webapps
> {noformat}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message