Return-Path: X-Original-To: apmail-jmeter-user-archive@www.apache.org Delivered-To: apmail-jmeter-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3C1AE189A6 for ; Sun, 8 Nov 2015 09:09:36 +0000 (UTC) Received: (qmail 50856 invoked by uid 500); 8 Nov 2015 09:09:35 -0000 Delivered-To: apmail-jmeter-user-archive@jmeter.apache.org Received: (qmail 50820 invoked by uid 500); 8 Nov 2015 09:09:35 -0000 Mailing-List: contact user-help@jmeter.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "JMeter Users List" Delivered-To: mailing list user@jmeter.apache.org Received: (qmail 50809 invoked by uid 99); 8 Nov 2015 09:09:35 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 08 Nov 2015 09:09:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id EDE921A0855 for ; Sun, 8 Nov 2015 09:09:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.981 X-Spam-Level: ** X-Spam-Status: No, score=2.981 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=bosoconsulting_it.20150623.gappssmtp.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id p_DVLktkBjq7 for ; Sun, 8 Nov 2015 09:09:29 +0000 (UTC) Received: from mail-lb0-f174.google.com (mail-lb0-f174.google.com [209.85.217.174]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id A505E206E8 for ; Sun, 8 Nov 2015 09:09:28 +0000 (UTC) Received: by lbbkw15 with SMTP id kw15so75644067lbb.0 for ; Sun, 08 Nov 2015 01:09:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bosoconsulting_it.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=v4p2CCRtVQQ9Bt5E1KIExU0ZdfGCQGLee9I6aI30cH0=; b=l+6mZbIFC2HyIBD7EM2GYwN1p1q2zG097p5amF21yein3G4Zbu1SIParB6nsYUpBQL QDblCgfc8e37d/5SQlaGhEf9ZjhfgXAollEEGgHGNJa0RBloXH/sazNCARa3nVvL0UP4 aTAWY96mPYxpNEGNvxW16XdbDJxve4s4MS6F0o+yJb8KDISVPCQEfBbYzjItAf/xu3fn H9O78QWbY1T6Mee8OQ2DnUJs1fVBya5VxRDOR/90hNFcA9ttPi++rU+6YiBfd3NoudCG EGGnJnSXvHmrNLIhsKHQso0pzeJEvZPfgULc3hzLbkAnO1UMLl6ClWPlCiA0qZ0oggAC plzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=v4p2CCRtVQQ9Bt5E1KIExU0ZdfGCQGLee9I6aI30cH0=; b=WyBEzWYi+E1LRC7K0yEKUfqHR6aGslTxcx04lyPWJPGdHJ2uLeJcDQ/0UtN0XV3T/f tU898Nk21NjMXCA2iYrTiLCv9x92hChmAzpKL0zz0DOzM6aeqqhczOTyplIQaFX+CmBL y5nRvghnnOyvw/NxLn0S+xwH5/Ye/e5fzQBJQx7ypZV5Wee/jNXxLGZEJFzxB89Zg5dH 57NjDdZo6d4xG/u3azkrm6Yx3TTQtJWE+6h84hVvw6FBcUaj/1O8FNZpOwmgQmLj9uj8 HOBesKonPVkakME39Ssh0ZKO93JcSq8fetGtkzD1nHz51UIu14uusimXMOG75uKXMHZI HCSQ== X-Gm-Message-State: ALoCoQlSFtWANNHbBZYThG1Jf8Q3HLF/6SoL4jkY1Il63xk4ZBI/BhjiSCVQfM112d/wMFt3FmXl MIME-Version: 1.0 X-Received: by 10.112.134.73 with SMTP id pi9mr11260743lbb.83.1446973767903; Sun, 08 Nov 2015 01:09:27 -0800 (PST) Received: by 10.25.209.81 with HTTP; Sun, 8 Nov 2015 01:09:27 -0800 (PST) Received: by 10.25.209.81 with HTTP; Sun, 8 Nov 2015 01:09:27 -0800 (PST) In-Reply-To: <6197868531f64f52904fd3ff7aeb715f@XCH-RCD-009.cisco.com> References: <030753af546045a8b661ddc32e82aa24@XCH-RCD-009.cisco.com> <41053236d8e04e0082f2a46422c2f23e@XCH-RCD-009.cisco.com> <6197868531f64f52904fd3ff7aeb715f@XCH-RCD-009.cisco.com> Date: Sun, 8 Nov 2015 10:09:27 +0100 Message-ID: Subject: RE: not all 50 http samplers to download file are executed From: Sergio Boso To: JMeter Users List Content-Type: multipart/alternative; boundary=047d7b3a8c466f8089052403d501 --047d7b3a8c466f8089052403d501 Content-Type: text/plain; charset=UTF-8 Hi Charles, If I remember well, if you check the "save MD5 only", the full data is not kept in memory. You can check that data are data correct and you save substantial amount of memory. Other approach may involve OS sampler and wget operation. Regards Sergio Boso Il 08/Nov/2015 07:24, "Charles Lin (charlin)" ha scritto: > I changed my script from 1 Thread Group with 50 users, to 50 Thread Group > each with 1 user. Well, it does not do what I want which is concurrent > downloading. > > Thread Group 2 does not start until Thread Group 1 finishes, which in this > case means a long wait for one 310 MB to complete download, before next > Thread Group (= next downloading) can begin. > > So either I have to increase heap memory even more, or use two or three > machines to run JMeter so as to get 50 concurrent downloads. > > If you have other good suggestions please let me know. > > Thank you! > > Charles > > -----Original Message----- > From: Charles Lin (charlin) > Sent: Saturday, November 07, 2015 9:39 PM > To: JMeter Users List > Subject: RE: not all 50 http samplers to download file are executed > > Hi Deepak, > > Thank you for your response. > > After I submitted my question, I started analyzing the logs, and as you > suspected, the problem was java out of heap memory > > I increased my JVM_ARG to -Xms=4096- Xmx=8000, and was able to get more > files download to complete. But still, I only got 20 out of 50 total > download that I had hoped for. > > Is there some timer or timing arrangement with my sampler arrangement > under the Thread Group that I can play with to overcome this heap memory > issue? > > How about instead of a single Thread Group with 5 HTTPS samplers under it > (the first 4 leading up to the 5th which is the actual file downloading > request), right now I run this Thread Group with User = 50, Ramp = 100 sec, > cycle = 1 ... instead of that, what if I make them into 5 separate Thread > Group, each thread group with User = 1, Ramp=1, cycle =1. Will I be able > to launch all 50 Thread Groups sequentially but quickly, one after > another? For each Thread Group, like I said, 5 samplers are needed to > cause the download to begin. All 5 executes quickly, but the 5th request > will take time to finish (for 310 MB to download). But as soon as Group > 1-5 is done (but downloading now in progress), will Group 2-1 ~ 2-5 start > to execute? > > Will doing the above help to release the heap memory? In other words, as > Thread 1-5 finish dumping data to local file, that memory will be freed for > following succession of Thread 2-5, 3-5, 4-5, 5-5, 6-5, etc to use while > they also finish up dumping data to file? > > Thank you > > Charles > > > > > 2015/11/07 18:43:25 DEBUG - jmeter.threads.ThreadGroup: Ending thread > Thread Group 1-1 > 2015/11/07 18:43:30 ERROR - jmeter.threads.JMeterThread: Test failed! > java.lang.OutOfMemoryError: Java heap space > > 2015/11/07 18:43:31 ERROR - jmeter.threads.JMeterThread: Test failed! > java.lang.OutOfMemoryError: Java heap space > > 2015/11/07 18:43:31 INFO - jmeter.threads.JMeterThread: Thread finished: > Thread Group 1-40 > 2015/11/07 18:43:30 ERROR - jmeter.threads.JMeterThread: Test failed! > java.lang.OutOfMemoryError: Java heap space > at java.io.ByteArrayOutputStream.(Unknown Source) > at > org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.readResponse(HTTPSamplerBase.java:1741) > at > org.apache.jmeter.protocol.http.sampler.HTTPAbstractImpl.readResponse(HTTPAbstractImpl.java:412) > at > org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.sample(HTTPHC4Impl.java:352) > at > org.apache.jmeter.protocol.http.sampler.HTTPSamplerProxy.sample(HTTPSamplerProxy.java:74) > at > org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1146) > at > org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1135) > at > org.apache.jmeter.threads.JMeterThread.process_sampler(JMeterThread.java:434) > at > org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:261) > at java.lang.Thread.run(Unknown Source) > > > -----Original Message----- > From: Deepak Shetty [mailto:shettyd@gmail.com] > Sent: Saturday, November 07, 2015 8:11 PM > To: JMeter Users List > Subject: Re: not all 50 http samplers to download file are executed > > Did you check jmeter.log for errors like out of memory ? > On Nov 7, 2015 1:11 PM, "Charles Lin (charlin)" wrote: > > > --047d7b3a8c466f8089052403d501--