accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-804) Hadoop 2.0 Support
Date Tue, 26 Nov 2013 15:18:46 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832650#comment-13832650
] 

ASF subversion and git services commented on ACCUMULO-804:
----------------------------------------------------------

Commit 4f7fb04b0b485377daa7d0bd0985994d1ce86173 in branch refs/heads/1.4.5-SNAPSHOT from [~busbey]
[ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=4f7fb04 ]

ACCUMULO-804 pick up the new location of the hadoop jars

git-svn-id: https://svn.apache.org/repos/asf/accumulo/branches/1.5@1456640 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 21780bd2950df7e72a8b1bd3ddef5017b07b63ad)

Reason: Hadoop2 Compat
Author: Eric C. Newton <ecn@apache.org>
Ref: ACCUMULO-1792

Skips changes to MiniAccumuloCluster that were already present in backport.

Signed-off-by: Eric Newton <eric.newton@gmail.com>


> Hadoop 2.0 Support
> ------------------
>
>                 Key: ACCUMULO-804
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-804
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: client
>    Affects Versions: 1.4.3
>            Reporter: Ed Kohlwey
>            Assignee: Eric Newton
>              Labels: hackathon
>             Fix For: 1.5.0
>
>
> We should start thinking about Hadoop 2 support now that it is Cloudera's recommended
distribution and many new Hadoop users will probably be adopting it.
> When I investigated this first a few months ago it seemed like the biggest barrier to
this was that all the Map/Reduce related tests are implemented using pseudo-private constructors
from Hadoop 1.0 that are no-longer present in Hadoop 2.0.
> The main strategy to fix this should probably be to adopt the Map/Reduce cluster test
object for testing the various Accumulo input formats instead of instrumenting them directly.
I have used this convenience object successfully on tests utilizing MockInstance, so I think
it should work fine.
> There may also be some filesystem API issues but I don't think they will be too severe.
> The other main issue is that we will need to actually deploy on Hadoop 1 and 2 and run
the integration tests once we start supporting both, so that will be a headache for release
testing that we should think through.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message