mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gokhan Capan (JIRA)" <>
Subject [jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
Date Mon, 02 Dec 2013 21:42:35 GMT


Gokhan Capan commented on MAHOUT-1354:

Well, I tried something and want to share.

Based on:
In hadoop-2-stable, compatibility with hadoop-1 is preferred over with hadoop-2-alpha (
For example, return type for ProgramDriver#driver(String) was void in hadoop-1 (which we use
in MahoutDriver), int in hadoop-2-alpha, void again in hadoop-2-stable. It seems if we select
the right artifacts, there is nothing to worry about the compatibility. 

My conclusion was:
The current hadoop-0.20 and hadoop-0.23 profiles can be utilized: we can rename them to hadoop-1
and hadoop-2, respectively, then make hadoop-2 (stable) the default profile, then set the
hadoop.version property to 2.2.0. We need to worry about some third party dependencies though,
for instance, hbase-client in mahout-integration is dependent to hadoop-1 (for that particular
artifact, simply excluding hadoop-core did not break any tests, by the way).

> Mahout Support for Hadoop 2 
> ----------------------------
>                 Key: MAHOUT-1354
>                 URL:
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.8
>            Reporter: Suneel Marthi
>            Assignee: Suneel Marthi
>             Fix For: 1.0
> Mahout support for Hadoop , now that Hadoop 2 is official.

This message was sent by Atlassian JIRA

View raw message