hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: Question regarding FSDataOutputStream.close() behavior
Date Fri, 04 May 2012 17:52:13 GMT
On Fri, May 4, 2012 at 7:14 AM, John Vines <john.w.vines@ugov.gov> wrote:
> So I'm trying to figure out the behavior of calling DFSOutputStream.close(),
> as well as if/which version it changed in. I see in the javadocs that the
> complete call (which close calls) will not return until "all the file's  *
> blocks have been replicated the minimum number of times".  Is the minimum
> number dfs.replication.min, or is it the files number of replications?

The former.

> Regardless of that answer, I'm curious when the behavior changed, if it
> hadn't been like that. I remember it used to be that it would utilize lazy
> replication, though that may just be for bringing underreplicated blocks up
> to snuff. Any insight would be appreciated.

I'm not aware of any change in recent years... what versions are you comparing?

Todd Lipcon
Software Engineer, Cloudera

View raw message