mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gokhan Capan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAHOUT-1354) Mahout Support for Hadoop 2
Date Mon, 02 Dec 2013 21:42:35 GMT

    [ https://issues.apache.org/jira/browse/MAHOUT-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836953#comment-13836953
] 

Gokhan Capan commented on MAHOUT-1354:
--------------------------------------

Well, I tried something and want to share.

Based on:
In hadoop-2-stable, compatibility with hadoop-1 is preferred over with hadoop-2-alpha (http://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html).
For example, return type for ProgramDriver#driver(String) was void in hadoop-1 (which we use
in MahoutDriver), int in hadoop-2-alpha, void again in hadoop-2-stable. It seems if we select
the right artifacts, there is nothing to worry about the compatibility. 

My conclusion was:
The current hadoop-0.20 and hadoop-0.23 profiles can be utilized: we can rename them to hadoop-1
and hadoop-2, respectively, then make hadoop-2 (stable) the default profile, then set the
hadoop.version property to 2.2.0. We need to worry about some third party dependencies though,
for instance, hbase-client in mahout-integration is dependent to hadoop-1 (for that particular
artifact, simply excluding hadoop-core did not break any tests, by the way).

> Mahout Support for Hadoop 2 
> ----------------------------
>
>                 Key: MAHOUT-1354
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1354
>             Project: Mahout
>          Issue Type: Improvement
>    Affects Versions: 0.8
>            Reporter: Suneel Marthi
>            Assignee: Suneel Marthi
>             Fix For: 1.0
>
>
> Mahout support for Hadoop , now that Hadoop 2 is official.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message