hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Vines <john.w.vi...@ugov.gov>
Subject Re: Question regarding FSDataOutputStream.close() behavior
Date Fri, 04 May 2012 19:10:29 GMT
On Fri, May 4, 2012 at 1:53 PM, Todd Lipcon <todd@cloudera.com> wrote:

> On Fri, May 4, 2012 at 7:14 AM, John Vines <john.w.vines@ugov.gov> wrote:
> > So I'm trying to figure out the behavior of calling
> DFSOutputStream.close(),
> > as well as if/which version it changed in. I see in the javadocs that the
> > complete call (which close calls) will not return until "all the file's
> *
> > blocks have been replicated the minimum number of times".  Is the minimum
> > number dfs.replication.min, or is it the files number of replications?
>
> The former.
>
> >
> > Regardless of that answer, I'm curious when the behavior changed, if it
> > hadn't been like that. I remember it used to be that it would utilize
> lazy
> > replication, though that may just be for bringing underreplicated blocks
> up
> > to snuff. Any insight would be appreciated.
>
> I'm not aware of any change in recent years... what versions are you
> comparing?
>
> I thought it had made changes in the last few releases, but I guess I was
mistaken. Thank you for the help.


> -Todd
> --
> Todd Lipcon
> Software Engineer, Cloudera
>

John

Mime
View raw message