hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Wang <andrew.w...@cloudera.com>
Subject Re: Thinking ahead to hadoop-2.6
Date Tue, 23 Sep 2014 22:27:12 GMT
Hey Arun,

Maybe we could do a quick run through of the Roadmap wiki and add/retarget
things accordingly?

I think the KMS and transparent encryption are ready to go. We've got a
very few further bug fixes pending, but that's it.

Two HDFS things that I think probably won't make the end of the week are
archival storage (HDFS-6584) and single replica memory writes (HDFS-6581),
which I believe are under the HSM banner. HDFS-6484 was just merged to
trunk and I think needs a little more work before it goes into branch-2.
HDFS-6581 hasn't even been merged to trunk yet, so seems a bit further off
yet.

Just my 2c as I did not work directly on these features. I just generally
shy away from shipping bits quite this fresh.

Thanks,
Andrew

On Tue, Sep 23, 2014 at 3:03 PM, Arun Murthy <acm@hortonworks.com> wrote:

> Looks like most of the content is in and hadoop-2.6 is shaping up nicely.
>
> I'll create branch-2.6 by end of the week and we can go from there to
> stabilize it - hopefully in the next few weeks.
>
> Thoughts?
>
> thanks,
> Arun
>
> On Tue, Aug 12, 2014 at 1:34 PM, Arun C Murthy <acm@hortonworks.com>
> wrote:
>
> > Folks,
> >
> >  With hadoop-2.5 nearly done, it's time to start thinking ahead to
> > hadoop-2.6.
> >
> >  Currently, here is the Roadmap per the wiki:
> >
> >         • HADOOP
> >                 • Credential provider HADOOP-10607
> >         • HDFS
> >                 • Heterogeneous storage (Phase 2) - Support APIs for
> using
> > storage tiers by the applications HDFS-5682
> >                 • Memory as storage tier HDFS-5851
> >         • YARN
> >                 • Dynamic Resource Configuration YARN-291
> >                 • NodeManager Restart YARN-1336
> >                 • ResourceManager HA Phase 2 YARN-556
> >                 • Support for admin-specified labels in YARN YARN-796
> >                 • Support for automatic, shared cache for YARN
> application
> > artifacts YARN-1492
> >                 • Support NodeGroup layer topology on YARN YARN-18
> >                 • Support for Docker containers in YARN YARN-1964
> >                 • YARN service registry YARN-913
> >
> >  My suspicion is, as is normal, some will make the cut and some won't.
> > Please do add/subtract from the list as appropriate. Ideally, it would be
> > good to ship hadoop-2.6 in a 6-8 weeks (say, October) to keep up a
> cadence.
> >
> >  More importantly, as we discussed previously, we'd like hadoop-2.6 to be
> > the *last* Apache Hadoop 2.x release which support JDK6. I'll start a
> > discussion with other communities (HBase, Pig, Hive, Oozie etc.) and see
> > how they feel about this.
> >
> > thanks,
> > Arun
> >
> >
>
>
> --
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message