hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10995) HBase cannot run correctly with Hadoop trunk
Date Mon, 25 Aug 2014 05:23:58 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108753#comment-14108753

Zhijie Shen commented on HADOOP-10995:

bq. In general, I'm opposed to create circular dependency by putting hbase dependency into
the pom.

I'm not sure we should simply conclude cyclic dependency that hbase depends on hadoop and
hadoop depends on hbase now, because both projects are divided into multiple artifacts. In
YARN-2032, in hadoop-yarn-server-applicatioinhistoryservice, we only want to add hbase-client
and hbase-testing-util, which have dependency on hadoop-common, hadoop-auth, hadoop-hdfs,
hadoop-mapreduce-client-core and some others. However, none of them actually depend on hadoop-yarn-server-applicatioinhistoryservice,
resulting in cyclic dependency. Therefore, with the attached dependency change, the project
is built secussefully. In fact, you can consider hadoop-yarn-server-applicatioinhistoryservice
as an independent project that depends on hadoop-common, as hbase-client/hbase-testing-util
does. The dependency is still going to be a DAG after the change.

bq. This change assumes binary compatibilities of hadoop-common and hadoop-auth between trunk
and 2.x.

As hbase 0.9x is built against branch-2. It's going to be binary incompatible against trunk,
and this is why I raised the this Jira. However, this Jira is not aiming to ensure thorough
binary compatibility between trunk and 2.x, but getting back the necessary pieces to unblock
the tests against hbase mini cluster. Once the new version hbase dependency rebases to the
new API (i.e., HttpServer2 and Syncable.hsync), These pieces should be safe to be removed.
Hopefully it's a fair point.

> HBase cannot run correctly with Hadoop trunk
> --------------------------------------------
>                 Key: HADOOP-10995
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10995
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>            Priority: Critical
>         Attachments: HADOOP-10995.1.patch, YARN-2032.dependency.patch
> Several incompatible changes that happened on trunk but not on branch-2 have broken the
compatibility for HBbase:
> HADOOP-10348
> HADOOP-8124
> HADOOP-10255
> In general, HttpServer is and Syncable.sync have been missed.
> It blocks YARN-2032, which makes timeline sever support HBase store.

This message was sent by Atlassian JIRA

View raw message