metamodel-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tomasz Guzialek (JIRA)" <>
Subject [jira] [Commented] (METAMODEL-93) Upgrade HBase dependency to support Hadoop 2
Date Mon, 09 Feb 2015 11:19:34 GMT


Tomasz Guzialek commented on METAMODEL-93:

The proposal for the solution with classifiers is available in my fork:

It introduced two build profiles: hadoop1 and hadoop2 (hadoop2 being the default). The command
"mvn install -Phadoop1" will produce MetaModel-hbase-{metamodel.version}-hadoop1.jar with
hbase-client in version 0.95.1-hadoop1 as a dependency. The command "mvn install -Phadoop2"
(or just "mvn install") will produce MetaModel-hbase-{metamodel.version}-hadoop2.jar with
hbase-client in version 0.98.1-hadoop2 as a dependency.

Now the MetaModel-hbase module can be imported a dependency in such a manner:

Unfortunately, Eclipse seems to have a problem with such a setup. The dependency tree looks
absolutely correct (both MetaModel-hbase and hbase-client dependencies are present and in
correct versions), but in the runtime ClassNotFoundException is being thrown. Running from
command line seems to be working fine, although maven-assembly-plugin is needed to build jar-with-dependencies.

However, HBase as a dependency seems to be very unstable, so sticking to just two versions
of hbase-client might be not enough. Forcing the user to import MetaModel-hbase and explicitly
hbase-client in a correct version might be a better and easier solution. I am looking forward
to your thoughts.

> Upgrade HBase dependency to support Hadoop 2
> --------------------------------------------
>                 Key: METAMODEL-93
>                 URL:
>             Project: Apache MetaModel
>          Issue Type: Improvement
>    Affects Versions: 4.3.0-incubating
>         Environment: Cloudera CDH 5.1.0
>            Reporter: Tomasz Guzialek
>              Labels: hadoop
> Current hbase-client dependency version in HBase module is 0.95.1-hadoop1. We should
consider upgrading our depedency to support Hadoop 2.
> I tried to connect to HBase in Cloudera's Quickstart VM with CDH 5.1.0 from MetaModel,
but it is using HBase 0.98.1 (Hadoop 2). I guess, many people start with this popular distribution
for a proof of concept, so ensuring that MetaModel can connect to HBase on Hadoop 2 is important.

This message was sent by Atlassian JIRA

View raw message