hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsz Wo Sze <szets...@yahoo.com.INVALID>
Subject Re: [VOTE] Merge HDFS-6584 Archival Storage to trunk
Date Fri, 19 Sep 2014 14:21:29 GMT
Hi HDFS dev,

The HDFS-6584 branch has been merged to trunk.  We will finish the following two items before
merging it to branch-2.

- HDFS-7081  Add new DistributedFileSystem API for getting all the existing storage policies
- HDFS-7095  TestStorageMover often fails in Jenkins

Thanks for all the great work!
Tsz-Wo




On Friday, September 19, 2014 6:19 AM, Tsz Wo Sze <szetszwo@yahoo.com> wrote:
 

>
>
>Hi HDFS dev,
>
>
>We have four +1's  (Vinay, Jitendra, Arpit and me) and no -1's.  The VOTE passed.
>
>
>PS: Sorry that my email box seems having some problem.  I somehow did not receive 
Arpit's VOTE and some other emails. The email I sent last time (forwarded below) did not go
out.
>
>
>
>Thanks everyone.
>Tsz-Wo
>
>
>
>
>
>
>On Tuesday, September 16, 2014 11:20 PM, Tsz Wo Sze <szetszwo@yahoo.com> wrote:
> 
>
>>
>>
>>Hi HDFS dev,
>>
>>
>>We have three binding +1's (Vinay, Jitendra and me) and no -1's.  The VOTE passed.
>>
>>
>>Thanks everyone.
>>Tsz-Wo
>>
>>
>>
>>On Monday, September 8, 2014 4:03 PM, Nate Payne <npayne@cardinalpath.com> wrote:
>> 
>>
>>>
>>>
>>>+1. Great work everyone.
>>>
>>>On Sun, Sep 7, 2014 at 11:17 PM, Jitendra Pandey <jitendra@hortonworks.com>
>>>wrote:
>>>
>>>> +1. Great work by Nicholas and Jing.
>>>>
>>>>
>>>> On Sun, Sep 7, 2014 at 8:09 PM, Vinayakumar B <vinayakumarb@apache.org>
>>>> wrote:
>>>>
>>>> > I have closely observed all work done in this. This featute is very
>>>> > important for the storage only problems.
>>>> >
>>>> > Major work done by
 Nicholas and later Jing.
>>>> >
>>>> > Thanks to everyone who has participated in this.
>>>> >
>>>> > I feel the code is in good state to be merged to trunk.
>>>> > +1 for the merge.
>>>> >
>>>> > Regards,
>>>> > Vinay
>>>> > On Sep 8, 2014 1:29 AM, "Tsz Wo Sze" <szetszwo@yahoo.com.invalid>
wrote:
>>>> >
>>>> > > Hi HDFS dev,
>>>> > >
>>>> > > We would like to propose merging the development branch
>>>> > > HDFS-6584 back to trunk.
>>>> > >
>>>> > > The work of HDFS-6584 is to support Archival Storage in
>>>>
 > > HDFS.  Hadoop needs a solution to
>>>> > > decouple growing storage capacity from compute capacity. Nodes
with
>>>> > higher
>>>> > > density and less expensive storage with low compute power are becoming
>>>> > > available and can be used as cold storage in the clusters. Based
on
>>>> > > policy, the
>>>> > > data from hot can be moved to the cold. Adding more nodes to the
cold
>>>> > > storage
>>>> > > can grow the storage independent of the compute capacity in the
>>>> cluster.
>>>> > >
>>>> > > The Archival
 Storage feature introduces a new concept of
>>>> > > storage policies (Hot, Warm, Cold) to HDFS and allows files to
be
>>>> stored
>>>> > in
>>>> > > different storage medias (DISK, ARCHIVE) according to the storage
>>>> policy.
>>>> > > A new data migration tool is added for
>>>> > > archiving data.  For more details, please
>>>> > > see the design doc posted in HDFS-6584.
>>>> > >
>>>> > > There are currently 22 sub-tasks in HDFS-6584.  The main feature
of
>>>> > > HDFS-6584 is implemented
>>>> > > and tested.  The remaining work is adding
>>>> > > user documentation, adding a test plan doc, adding more tests and
>>>> fixing
>>>> > > some
>>>> > > minor bugs.  We will finish all of the
>>>> > > remaining work before merging the branch to trunk.
>>>> > >
>>>> > > The contributors of this work include Jing Zhao, Arpit
>>>> > > Agarwal, Vinayakumar B, Suresh Srinivas, Sanjay Radia, Jitendra
Pandey,
>>>> > > Haohui
>>>> > > Mai and Tsz-Wo Nicholas Sze.  We thank
>>>> > > the community
 for giving valuable comments and feedbacks on the design
>>>> of
>>>> > > this
>>>> > > work.
>>>> > >
>>>> > > The vote will last for 7 days.  Of course, I am +1 on it.
>>>> > >
>>>> > > Regards,
>>>> > > Tsz-Wo
>>>> > >
>>>> >
>>>>
>>>>
>>>>
>>>> --
>>>> <http://hortonworks.com/download/>
>>>
>>>>
>>>> --
>>>> CONFIDENTIALITY NOTICE
>>>> NOTICE: This message is intended for the use of the individual or entity
to
>>>> which it is addressed and may contain information that is confidential,
>>>> privileged and exempt from disclosure under applicable law. If the reader
>>>> of this message is not the intended recipient, you are hereby notified that
>>>> any printing, copying, dissemination, distribution, disclosure or
>>>> forwarding of this communication is strictly prohibited. If you have
>>>> received this
 communication in error, please contact the sender immediately
>>>> and delete it from your system. Thank You.
>>>>
>>>
>>>
>>>
>>>-- 
>>>Nathaniel Payne
>>>Senior Data Architect
>>>phone +1.778.374.3004 x236
>>>web CardinalPath.com
>>><http://www.cardinalpath.com/?utm_campaign=cp-personal&utm_source=npayne&utm_medium=email&utm_content=signature>
>>>
>>>-- 
>>>
>>>
>>>Research shows that organizations with high online analytics maturity 
>>><http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature>

>>>get better ROI from their digital marketing and analytics investments. Not 
>>>sure what your organization's analytics maturity is? Do you want to see how 
>>>you compare to over 900 companies
 worldwide? Take the Online Analytics 
>>>Maturity Assessment (OAMA) 
>>><http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature>

>>>and find out
 now! 
>>>
>>>This email, including any attachments, is for the sole use of the intended 
>>>recipient and may contain confidential information. If you are not the 
>>>intended recipient, please immediately notify us by reply email or by 
>>>telephone, delete this email and destroy any copies. Thank you
>>>
>>>
>>>
>>>
>>>
>>
>>
>
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message