hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nick Dimiduk (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8438) Extend bin/hbase to print a "minimal classpath" for used by other tools
Date Wed, 13 Nov 2013 00:23:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820720#comment-13820720
] 

Nick Dimiduk commented on HBASE-8438:
-------------------------------------

For completeness, I've verified that specifying custom entries also works:

{noformat}
$ ./bin/hbase mapredcp -Dtmpjars=foo,bar,baz 2>/dev/null | tr ':' '\n'
/Users/ndimiduk/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar
/Users/ndimiduk/repos/hbase/hbase-hadoop-compat/target/hbase-hadoop-compat-0.96.1-SNAPSHOT.jar
foo
/Users/ndimiduk/.m2/repository/org/cloudera/htrace/htrace-core/2.01/htrace-core-2.01.jar
/Users/ndimiduk/repos/hbase/hbase-common/target/hbase-common-0.96.1-SNAPSHOT.jar
/Users/ndimiduk/repos/hbase/hbase-client/target/hbase-client-0.96.1-SNAPSHOT.jar
/Users/ndimiduk/.m2/repository/io/netty/netty/3.6.6.Final/netty-3.6.6.Final.jar
/Users/ndimiduk/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar
/Users/ndimiduk/.m2/repository/org/apache/hadoop/hadoop-core/1.1.2/hadoop-core-1.1.2.jar
baz
/Users/ndimiduk/repos/hbase/hbase-protocol/target/hbase-protocol-0.96.1-SNAPSHOT.jar
bar
/Users/ndimiduk/.m2/repository/com/google/guava/guava/12.0.1/guava-12.0.1.jar
{noformat}

> Extend bin/hbase to print a "minimal classpath" for used by other tools
> -----------------------------------------------------------------------
>
>                 Key: HBASE-8438
>                 URL: https://issues.apache.org/jira/browse/HBASE-8438
>             Project: HBase
>          Issue Type: Improvement
>          Components: scripts
>    Affects Versions: 0.94.6.1, 0.95.0
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.98.0, 0.96.1
>
>         Attachments: 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch, 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch,
0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch, 0001-HBASE-8438-Extend-bin-hbase-to-print-a-minimal-class.patch
>
>
> For tools like pig and hive, blindly appending the full output of `bin/hbase classpath`
to their own CLASSPATH is excessive. They already build CLASSPATH entries for hadoop. All
they need from us is the delta entries, the dependencies we require w/o hadoop and all of
it's transitive deps. This is also a kindness for Windows, where there's a shorter limit on
the length of commandline arguments.
> See also HIVE-2055 for additional discussion.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message