hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eli Collins <...@cloudera.com>
Subject Re: libhdfs with FileSystem cache issue can causes to memory leak ?
Date Tue, 13 Oct 2009 17:14:09 GMT
Hey Huy,

What version of hadoop are you using?  I think HADOOP-4655 may have
resolved the issue you're seeing but I think is only in 20 and later.

Thanks,
Eli

On Mon, Oct 12, 2009 at 8:52 PM, Huy Phan <dachuy@gmail.com> wrote:
> Hi All,
>    I'm writing a multi-thread application using libhdfs in C, a known issue
> of HDFS is that the FileSystem API caches FileSystem handles and always
> returned the same FileSystem handle when called from different threads. It
> means even though I called hdfsConnect for many times, I should not call
> hdfsDisconnect in any single thread.
> This may lead to memory leak on system, do you know any workaround for this
> issue ?
>

Mime
View raw message