accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <>
Subject Re: [DISCUSS] Hadoop 2 and Accumulo 1.6.0
Date Thu, 24 Oct 2013 04:58:54 GMT
Highlights from

     YARN - A general purpose resource management system for Hadoop to 
allow MapReduce and other other data processing frameworks and services
     High Availability for HDFS
     HDFS Federation
     HDFS Snapshots
     NFSv3 access to data in HDFS
     Support for running Hadoop on Microsoft Windows
     Binary Compatibility for MapReduce applications built on hadoop-1.x
     Substantial amount of integration testing with rest of projects in 
the ecosystem

Additionally, I believe there are substantial improvements in HDFS which 
should improve general performance for all filesystem ops.

On 10/23/13 9:51 PM, William Slacum wrote:
> There wasn't any discussions in those tickets as to what Hadoop 2 provides
> Accumulo. If we're going to still support 1, then any new features only
> possible with 2 have to become optional until we ditch support for 1. Is
> there anything people have in mind, feature wise, that Hadoop 2 would help
> with?
> On Wed, Oct 23, 2013 at 7:05 PM, Josh Elser <> wrote:
>> To ensure that we get broader community interaction than only on a Jira
>> issue [1], I want to get community feedback about the version of Hadoop
>> which the default, deployed Accumulo artifacts will be compiled against.
>> Currently, Accumulo builds against a Hadoop-1 series release
>> (1.5.1-SNAPSHOT and 1.6.0-SNAPSHOT build against 1.2.1, and 1.5.0 builds
>> against 1.0.4). Last week, the Apache Hadoop community voted to release
>> 2.2.0 as GA (general availability) -- in other words, the Apache Hadoop
>> community is calling Hadoop-2.2.0 "stable".
>> As has been discussed across various issues on Jira, this means a few
>> different things for Accumulo. Most importantly, this serves as a
>> recommendation by us that users should be trying to use Hadoop-2.2.0 with
>> Accumulo 1.6.0. This does *not* mean that we do not support Hadoop1 ([2]
>> 1.2.1 specifically). Hadoop-1 support would still be "guaranteed" by us for
>> 1.6.0.
>> - Josh
>> [1]**jira/browse/ACCUMULO-1419<>
>> [2]**jira/browse/ACCUMULO-1643<>

View raw message