hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1608) [HbaseShell] Relational Algrebra Operators
Date Tue, 17 Jul 2007 04:37:05 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12513147

stack commented on HADOOP-1608:

Thinking more on my above comment, it won't get you far.  It may work for all running in single
context but will fail when you go to distribute your jar across multiple hosts.

Either copy the hadoop-hbase.jar to $HADOOP_HOME/lib everywhere on your cluster or build the
hadoop-hbase.jar into your job jar under its lib directory.

Regards the latter, job jars submitted to hadoop are undone by the RunJar class out on each
tasktracker node.  Before invoking the jar's Main-Class from its MANIFEST.MF (or reading from
the command-line if this is not set), it sets up the CLASSPATH so all jars found in the jars'
lib directory, etc., are included.  See the RunJar source for how this is done if you want
to learn more (For an example, see nutch).

I took a look at bin/hadoop to add contribs to the classpath.  We could make a patch to add
'build/contrib/*/classes'.  This would work for development environment but for binary distributions,
the distribution target could add contrib jars to the lib dir or into a hadoop-contrib sub-directory
that got added to the classpath when bin/hadoop runs.

> [HbaseShell] Relational Algrebra Operators
> ------------------------------------------
>                 Key: HADOOP-1608
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1608
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: contrib/hbase
>    Affects Versions: 0.13.0
>         Environment: All environments 
>            Reporter: edward yoon
>            Priority: Minor
>             Fix For: 0.14.0
>         Attachments: shell_r_operators_v01.patch
> Development of relational algebra operators has begun.
>  * Projection 
>  * Selection 
>  * Product 
>  * Rename
>  * Group
>  * Sort

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message