hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Wang <andrew.w...@cloudera.com>
Subject Re: [VOTE] Merge HDFS-6584 Archival Storage to trunk
Date Fri, 12 Sep 2014 01:17:50 GMT
Hi all,

I commented on HDFS-6584 with some feedback. Overall, the design looks
reasonable and I think most of it can be addressed after the merge, though
I'd appreciate a design doc rev and user docs that try to answer some of
these questions.

Thanks,
Andrew

On Mon, Sep 8, 2014 at 7:44 PM, Arpit Agarwal <aagarwal@hortonworks.com>
wrote:

> +1
>
> I reviewed the feature design and have followed the development. It is
> ready for merging into trunk.
>
>
> On Mon, Sep 8, 2014 at 1:03 AM, Nate Payne <npayne@cardinalpath.com>
> wrote:
>
> > +1. Great work everyone.
> >
> > On Sun, Sep 7, 2014 at 11:17 PM, Jitendra Pandey <
> jitendra@hortonworks.com
> > >
> > wrote:
> >
> > > +1. Great work by Nicholas and Jing.
> > >
> > >
> > > On Sun, Sep 7, 2014 at 8:09 PM, Vinayakumar B <vinayakumarb@apache.org
> >
> > > wrote:
> > >
> > > > I have closely observed all work done in this. This featute is very
> > > > important for the storage only problems.
> > > >
> > > > Major work done by Nicholas and later Jing.
> > > >
> > > > Thanks to everyone who has participated in this.
> > > >
> > > > I feel the code is in good state to be merged to trunk.
> > > > +1 for the merge.
> > > >
> > > > Regards,
> > > > Vinay
> > > > On Sep 8, 2014 1:29 AM, "Tsz Wo Sze" <szetszwo@yahoo.com.invalid>
> > wrote:
> > > >
> > > > > Hi HDFS dev,
> > > > >
> > > > > We would like to propose merging the development branch
> > > > > HDFS-6584 back to trunk.
> > > > >
> > > > > The work of HDFS-6584 is to support Archival Storage in
> > > > > HDFS.  Hadoop needs a solution to
> > > > > decouple growing storage capacity from compute capacity. Nodes with
> > > > higher
> > > > > density and less expensive storage with low compute power are
> > becoming
> > > > > available and can be used as cold storage in the clusters. Based
on
> > > > > policy, the
> > > > > data from hot can be moved to the cold. Adding more nodes to the
> cold
> > > > > storage
> > > > > can grow the storage independent of the compute capacity in the
> > > cluster.
> > > > >
> > > > > The Archival Storage feature introduces a new concept of
> > > > > storage policies (Hot, Warm, Cold) to HDFS and allows files to be
> > > stored
> > > > in
> > > > > different storage medias (DISK, ARCHIVE) according to the storage
> > > policy.
> > > > > A new data migration tool is added for
> > > > > archiving data.  For more details, please
> > > > > see the design doc posted in HDFS-6584.
> > > > >
> > > > > There are currently 22 sub-tasks in HDFS-6584.  The main feature
of
> > > > > HDFS-6584 is implemented
> > > > > and tested.  The remaining work is adding
> > > > > user documentation, adding a test plan doc, adding more tests and
> > > fixing
> > > > > some
> > > > > minor bugs.  We will finish all of the
> > > > > remaining work before merging the branch to trunk.
> > > > >
> > > > > The contributors of this work include Jing Zhao, Arpit
> > > > > Agarwal, Vinayakumar B, Suresh Srinivas, Sanjay Radia, Jitendra
> > Pandey,
> > > > > Haohui
> > > > > Mai and Tsz-Wo Nicholas Sze.  We thank
> > > > > the community for giving valuable comments and feedbacks on the
> > design
> > > of
> > > > > this
> > > > > work.
> > > > >
> > > > > The vote will last for 7 days.  Of course, I am +1 on it.
> > > > >
> > > > > Regards,
> > > > > Tsz-Wo
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > <http://hortonworks.com/download/>
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
> >
> >
> > --
> > Nathaniel Payne
> > Senior Data Architect
> > phone +1.778.374.3004 x236
> > web CardinalPath.com
> > <
> >
> http://www.cardinalpath.com/?utm_campaign=cp-personal&utm_source=npayne&utm_medium=email&utm_content=signature
> > >
> >
> > --
> >
> >
> > Research shows that organizations with high online analytics maturity
> > <
> >
> http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature
> > >
> > get better ROI from their digital marketing and analytics investments.
> Not
> > sure what your organization's analytics maturity is? Do you want to see
> how
> > you compare to over 900 companies worldwide? Take the Online Analytics
> > Maturity Assessment (OAMA)
> > <
> >
> http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature
> > >
> > and find out now!
> >
> > This email, including any attachments, is for the sole use of the
> intended
> > recipient and may contain confidential information. If you are not the
> > intended recipient, please immediately notify us by reply email or by
> > telephone, delete this email and destroy any copies. Thank you
> >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message