hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8053) Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages.
Date Fri, 23 Mar 2018 20:25:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16412001#comment-16412001
] 

Steve Loughran commented on YARN-8053:
--------------------------------------

we have a loop. Hadoop depends on HBase, HBase depends on Hadoop. So HBase is being built
against an older version of Hadoop & its transitive versions (guava). It's less visible
if you build everything yourself in one go, but the problem exists

w.r.t unwinding, does the hbase connector actually need to be built into hadoop: is there
a way to create an extra project which pulls in both

> Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase
packages.
> -----------------------------------------------------------------------------------------------
>
>                 Key: YARN-8053
>                 URL: https://issues.apache.org/jira/browse/YARN-8053
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Major
>             Fix For: 3.1.0, yarn-7055, 3.2.0
>
>         Attachments: YARN-8053-YARN-7055.01.patch, YARN-8053.01.patch
>
>
> It is observed that when we change the version number of hadoop leading build failure
because of dependency resolution conflicts for HBase-2 compilation. We see below error which
tells that hbase-server has dependency on hadoop-distcp. We also need to exclude hadoop-distcp
from exclusion list. 
> {code}
> 07:42:36 2018/03/19 14:42:36 INFO    : [ERROR] Failed to execute goal on project hadoop-yarn-server-timelineservice-hbase-client:
Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-client:jar:3.3.0-SNAPSHOT:
Could not find artifact org.apache.hadoop:hadoop-distcp:jar:3.3.0-SNAPSHOT in public 
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message