Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of dachuy@gmail.com designates
 216.239.58.189 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:user-agent:mime-version:to:subject:references
         :in-reply-to:content-type:content-transfer-encoding;
        b=s4OC8hpsyZW/lHGNQPEoe4qcJu85sy3z4kF12dOyRjdgc/Nq+lWoE9OGraVrrKSyLe
         qE8OTKfTKDNZiKHDyHOb2cAF2TVLLrRivIkZwdTocy/pIUgWzjMTrBDm22OVSecTkK5H
         IbM3muuA6mPZsBBETZnP3GaDDebwJXMbZabvs=
Message-ID: <4AD4BB78.7080403@gmail.com>
Date: Wed, 14 Oct 2009 00:40:08 +0700
From: Huy Phan <dachuy@gmail.com>
User-Agent: Thunderbird 2.0.0.23 (X11/20090817)
MIME-Version: 1.0
To: common-dev@hadoop.apache.org
Subject: Re: libhdfs with FileSystem cache issue can causes to memory leak
 ?
References: <49d4a370910122052m2e250bb7i3e107a610e79c32c@mail.gmail.com>
 <dfe484f00910131014i6b8da4e9o5eb36254421ea49e@mail.gmail.com>
In-Reply-To: <dfe484f00910131014i6b8da4e9o5eb36254421ea49e@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi Eli,
    You're right that the problem is resolved in 0.20 with function 
newInstance(), unfortunately my system's running on Hadoop 0.18.3 and 
i'm still looking for a way to patch this version without affecting the 
current system.

Regards,
Huy Phan

Eli Collins wrote:
> Hey Huy,
>
> What version of hadoop are you using?  I think HADOOP-4655 may have
> resolved the issue you're seeing but I think is only in 20 and later.
>
> Thanks,
> Eli
>
> On Mon, Oct 12, 2009 at 8:52 PM, Huy Phan <dachuy@gmail.com> wrote:
>   
>> Hi All,
>>    I'm writing a multi-thread application using libhdfs in C, a known issue
>> of HDFS is that the FileSystem API caches FileSystem handles and always
>> returned the same FileSystem handle when called from different threads. It
>> means even though I called hdfsConnect for many times, I should not call
>> hdfsDisconnect in any single thread.
>> This may lead to memory leak on system, do you know any workaround for this
>> issue ?
>>
>>     
>
>