hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daryn Sharp <da...@yahoo-inc.com>
Subject Re: [DISCUSS] Remove append?
Date Fri, 23 Mar 2012 17:03:01 GMT
I think Yarn/MR might be able to benefit from the ability to append to logs in hdfs.  It might
reduce some of the after-the-fact copying of logs into hdfs.


On Mar 22, 2012, at 8:18 PM, Dhruba Borthakur wrote:

> I think "append" would be useful. But not precisely sure which applications
> would use it. I would vote to keep the code though and not remove it.
> -dhruba
> On Thu, Mar 22, 2012 at 5:49 PM, Eli Collins <eli@cloudera.com> wrote:
>> On Thu, Mar 22, 2012 at 5:03 PM, Tsz Wo Sze <szetszwo@yahoo.com> wrote:
>>> @Eli, Removing a feature would simplify the design and code.  I think
>> this is a generally true statement but not specific to Append.  The
>> question is whether Append is useless and it should be removed?  I think it
>> is clear from this email thread that the answer is no.
>> @Nicholas, no one is saying append is "useless and should be removed."
>> The discussion is perhaps a little more subtle than you've understood
>> it to be.
>> If there are a lot of good use cases I'm all for it, I just don't see
>> downstream projects using it any time soon (which is not to say they
>> don't want it, just that they can't depend on something not in 1.x),
>> and I haven't seen much demand.  I wanted to hear from others if they
>> had.  When I brought it up with a room of hdfs developers from 3
>> different companies no one felt strongly. And so far only a handful of
>> people have chimed in, I actually thought more would.
>> Thanks,
>> Eli
> -- 
> Subscribe to my posts at http://www.facebook.com/dhruba

View raw message