hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13865) add tools to classpath by default in branch-2
Date Mon, 05 Dec 2016 11:04:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721974#comment-15721974
] 

Steve Loughran commented on HADOOP-13865:
-----------------------------------------

I have mixed feelings here. I like bits on the CLI, and indeed think we (hortonworks) stick
some more of the hadoop-aws and hadoop-azure stuff on our CP, albeit by copying them to somewhere
on that path

At the same time, the fact that we bleed so much of our CP into downstream programs makes
it a dangerous minefield about updating anything; the size of that CP means that it's inevitable
that we break things whenever we do —so are trapped into shipping out of date stuff (Guava,
Jackson) to minimise this pain (see HADOOP-9991).

Looking at your specific problem: distcp runs on the `hadoop distcp` command. Why exactly
were you trying to use it from hive?

> add tools to classpath by default in branch-2
> ---------------------------------------------
>
>                 Key: HADOOP-13865
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13865
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: scripts
>    Affects Versions: 2.8.0, 2.7.3
>            Reporter: Fei Hui
>            Assignee: Fei Hui
>         Attachments: HADOOP-13865-branch-2.001.patch
>
>
> when i run hive queries, i get errors as follow
> java.lang.NoClassDefFoundError: org/apache/hadoop/tools/DistCpOptions
> ...
> Maybe  run other hadoop apps which using hadoop tools classes, will get similar erros



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message