Mailing-List: contact httpclient-users-help@hc.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "HttpClient User Discussion" <httpclient-users@hc.apache.org>
MIME-Version: 1.0
In-Reply-To: 
 <CAKt23kWMZ_XZxfd1tW4tzCj2=3XcC0zxkwqwPmwUUAQhRKcgRg@mail.gmail.com>
References: 
 <CAKt23kUSMkieiG66vvgtf7KFWBKpta_p3AxyqQqdeYmouGQVQg@mail.gmail.com>
	<CACZkXPzuPw6RVfgFu40Qdxgg-0xiQtnyQEYSr+7RcvZCq69QAg@mail.gmail.com>
	<CAKt23kUSmmPYGU3KbSOLMt8_ezUAoRaoqJY4+Hpi2ai9DoHPDQ@mail.gmail.com>
	<1454440869.6614.0.camel@apache.org>
	<CAKt23kWDhFgrE1xoDGaSjnDH-RBG9cWak1PNT4A5CzbD1M1_2Q@mail.gmail.com>
	<1454442690.6614.6.camel@apache.org>
	<CAKt23kV6+yQ0oDTLyfA2vvE97NnzgVENb8TD_SkFCNHJSFpQaw@mail.gmail.com>
	<1454443907.6614.10.camel@apache.org>
	<CAKt23kUDmu2symLiNFMjCXZakpV3tN1LBFUp4xjd2pSp0dieOA@mail.gmail.com>
	<1454444503.6614.18.camel@apache.org>
	<CAP1s-NVtiZOaOaSAG7Pro6UnN83VvOkyz7tqRbuSbTXN2YSORw@mail.gmail.com>
	<1454445375.6614.27.camel@apache.org>
	<CAP1s-NXW14z8_-DFTi5W1TqsUBAi8iEZ5DDG_ER3bwapDE-P6g@mail.gmail.com>
	<CAKt23kVdyJnrR32OV2XmEn=hhHBZ1E2L-pcgTbC=UCHQpvtwQA@mail.gmail.com>
	<CACZkXPyUEGLGTyDhr7KfS45knYvEGd_+Fks7xp7gwDo3Bv24Cw@mail.gmail.com>
	<CAKt23kWMZ_XZxfd1tW4tzCj2=3XcC0zxkwqwPmwUUAQhRKcgRg@mail.gmail.com>
Date: Wed, 3 Feb 2016 15:22:31 -0500
Message-ID: 
 <CAP1s-NUAUXJssVtnD68M8+edDnnFqd1C=_J3vfdhKDkbPfYgjA@mail.gmail.com>
Subject: Re: HttpClientBuilder Memory Leak
From: Dan Quaroni <q@invoke.com>
To: HttpClient User Discussion <httpclient-users@hc.apache.org>
Content-Type: multipart/alternative; boundary=001a113f5facaa28ec052ae3607d

--001a113f5facaa28ec052ae3607d
Content-Type: text/plain; charset=UTF-8

David, can you try profiling it using visualvm and see if you can reproduce
the results?

On Wed, Feb 3, 2016 at 3:06 PM, David Skalka <david.skalka@gmail.com> wrote:

> Sorry for delay.
>
> java varsion is 1.8.0. 66-b17.  The graph was made by Jprofiler.
>
> I tested same code with Yourkit a Jconsole wihout any leak. I dont
> understand it.
>
> Can someone profile this code using JProfiler? It looks at the serious
> errors of JProfiler
>
>
> 2016-02-02 23:15 GMT+01:00 Gary Gregory <garydgregory@gmail.com>:
>
> > Curious: What profiler and java version are you using?
> >
> > Gary
> >
> > On Tue, Feb 2, 2016 at 1:39 PM, David Skalka <david.skalka@gmail.com>
> > wrote:
> >
> > > I updated httpclient to 4.5.1  and after 30minutes I see same result.
> > > memory is growing up
> > >
> > > 2016-02-02 21:51 GMT+01:00 Dan Quaroni <q@invoke.com>:
> > >
> > > > I don't really know what program is producing this image, but what I
> > see
> > > in
> > > > this picture is that there are a lot of Strings in memory, which seem
> > to
> > > be
> > > > living in HashMap(s).  I don't know how this program he used analyzes
> > > > memory usage... But either way, I can't reproduce it.
> > > >
> > > > On Tue, Feb 2, 2016 at 3:36 PM, Oleg Kalnichevski <olegk@apache.org>
> > > > wrote:
> > > >
> > > > > On Tue, 2016-02-02 at 15:29 -0500, Dan Quaroni wrote:
> > > > > > What version of HttpClient are you using?  I cut the sleep down
> to
> > > 1ms
> > > > > and
> > > > > > have had it running for 25 minutes and am not observing any such
> > > memory
> > > > > > leak.
> > > > > >
> > > > >
> > > > > If one takes even a cursory look at the memory profile one can
> > clearly
> > > > > see that out several dozen classes on the heap only one class
> belongs
> > > to
> > > > > HttpCient - CPool and there are only ~900 instances of that class
> > > > > compared to millions of instances of other classes.
> > > > >
> > > > > Oleg
> > > > >
> > > > > > On Tue, Feb 2, 2016 at 3:21 PM, Oleg Kalnichevski <
> > olegk@apache.org>
> > > > > wrote:
> > > > > >
> > > > > > > On Tue, 2016-02-02 at 21:16 +0100, David Skalka wrote:
> > > > > > > > what is it "own data" ?
> > > > > > > >
> > > > > > >
> > > > > > > https://drive.google.com/open?id=0B8cERbS5JTTtZkVpWmhVWS11UkU
> > > > > > >
> > > > > > > Oleg
> > > > > > >
> > > > > > >
> > > > > > > > 2016-02-02 21:11 GMT+01:00 Oleg Kalnichevski <
> olegk@apache.org
> > >:
> > > > > > > >
> > > > > > > > > On Tue, 2016-02-02 at 20:58 +0100, David Skalka wrote:
> > > > > > > > > > it is simple test application with one while. here is
> whole
> > > > > source
> > > > > > > code:
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Have you looked at your own data?
> > > > > > > > >
> > > > > > > > > Oleg
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > import java.io.IOException;
> > > > > > > > > >
> > > > > > > > > > import org.apache.http.impl.client.CloseableHttpClient;
> > > > > > > > > > import org.apache.http.impl.client.HttpClientBuilder;
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > public class Program {
> > > > > > > > > >
> > > > > > > > > >     public static void main(String[] args) throws
> > > IOException,
> > > > > > > > > > InterruptedException {
> > > > > > > > > >
> > > > > > > > > >         while(true){
> > > > > > > > > >             CloseableHttpClient httpclient =
> > > > > > > > > > HttpClientBuilder.create().build();
> > > > > > > > > >             httpclient.close();
> > > > > > > > > >             Thread.sleep(5);
> > > > > > > > > >         }
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >     }
> > > > > > > > > >
> > > > > > > > > > }
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > 2016-02-02 20:51 GMT+01:00 Oleg Kalnichevski <
> > > olegk@apache.org
> > > > >:
> > > > > > > > > >
> > > > > > > > > > > On Tue, 2016-02-02 at 20:42 +0100, David Skalka wrote:
> > > > > > > > > > > > sorry i dont understand you. What do you mean by
> "what
> > > does
> > > > > this
> > > > > > > all
> > > > > > > > > tell
> > > > > > > > > > > > you" ?
> > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Have you taken even a cursory look at your own data?
> > > > > > > > > > >
> > > > > > > > > > > What makes you think there is a leak in HttpClient?
> > > > > > > > > > >
> > > > > > > > > > > Oleg
> > > > > > > > > > >
> > > > > > > > > > > > 2016-02-02 20:21 GMT+01:00 Oleg Kalnichevski <
> > > > > olegk@apache.org>:
> > > > > > > > > > > >
> > > > > > > > > > > > > On Tue, 2016-02-02 at 19:30 +0100, David Skalka
> > wrote:
> > > > > > > > > > > > > > Here is long running snapshot with types
> > > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > https://drive.google.com/open?id=0B8cERbS5JTTtZkVpWmhVWS11UkU
> > > > > > > > > > > > >
> > > > > > > > > > > > > And what does this all tell you?
> > > > > > > > > > > > >
> > > > > > > > > > > > > Oleg
> > > > > > > > > > > > >
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > 2016-02-02 17:22 GMT+01:00 Gary Gregory <
> > > > > > > garydgregory@gmail.com
> > > > > > > > > >:
> > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Can you look and see what kind of objects are
> > > > retained?
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > Gary
> > > > > > > > > > > > > > > On Feb 2, 2016 2:33 AM, "David Skalka" <
> > > > > > > david.skalka@gmail.com
> > > > > > > > > >
> > > > > > > > > > > wrote:
> > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Why this code causes a memory leak?
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > code:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > *while(true){*
> > > > > > > > > > > > > > > > * CloseableHttpClient httpclient =
> > > > > > > > > > > > > HttpClientBuilder.create().build();*
> > > > > > > > > > > > > > > > * httpclient.close();*
> > > > > > > > > > > > > > > > * Thread.sleep(5);*
> > > > > > > > > > > > > > > > * }*
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > > Here is a graph of memory allocation:
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > https://drive.google.com/file/d/0B8cERbS5JTTtMnUyVXJNZDRFbHM/view
> > > > > > > > > > > > > > > >
> > > > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > > > > > To unsubscribe, e-mail:
> > > > > > > httpclient-users-unsubscribe@hc.apache.org
> > > > > > > > > > > > > For additional commands, e-mail:
> > > > > > > > > httpclient-users-help@hc.apache.org
> > > > > > > > > > > > >
> > > > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > > > > > To unsubscribe, e-mail:
> > > > > httpclient-users-unsubscribe@hc.apache.org
> > > > > > > > > > > For additional commands, e-mail:
> > > > > > > httpclient-users-help@hc.apache.org
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > > > > > To unsubscribe, e-mail:
> > > > httpclient-users-unsubscribe@hc.apache.org
> > > > > > > > > For additional commands, e-mail:
> > > > > httpclient-users-help@hc.apache.org
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > ---------------------------------------------------------------------
> > > > > > > To unsubscribe, e-mail:
> > httpclient-users-unsubscribe@hc.apache.org
> > > > > > > For additional commands, e-mail:
> > > httpclient-users-help@hc.apache.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: httpclient-users-unsubscribe@hc.apache.org
> > > > > For additional commands, e-mail:
> httpclient-users-help@hc.apache.org
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > >
> > > > *Daniel Quaroni*
> > > > Principal Software Architect
> > > > P: 781.810.2743
> > > > q@invoke.com
> > > > www.invoke.com
> > > > See a Demo here <http://www.invoke.com/platform/demo>
> > > >
> > >
> >
> >
> >
> > --
> > E-Mail: garydgregory@gmail.com | ggregory@apache.org
> > Java Persistence with Hibernate, Second Edition
> > <http://www.manning.com/bauer3/>
> > JUnit in Action, Second Edition <http://www.manning.com/tahchiev/>
> > Spring Batch in Action <http://www.manning.com/templier/>
> > Blog: http://garygregory.wordpress.com
> > Home: http://garygregory.com/
> > Tweet! http://twitter.com/GaryGregory
> >
>


-- 

*Daniel Quaroni*
Principal Software Architect
P: 781.810.2743
q@invoke.com
www.invoke.com
See a Demo here <http://www.invoke.com/platform/demo>

--001a113f5facaa28ec052ae3607d--