Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D219E562 for ; Thu, 21 Feb 2013 04:41:28 +0000 (UTC) Received: (qmail 15889 invoked by uid 500); 21 Feb 2013 04:41:27 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 15816 invoked by uid 500); 21 Feb 2013 04:41:27 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 15801 invoked by uid 99); 21 Feb 2013 04:41:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Feb 2013 04:41:26 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of shadowsor@gmail.com designates 209.85.220.179 as permitted sender) Received: from [209.85.220.179] (HELO mail-vc0-f179.google.com) (209.85.220.179) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Feb 2013 04:41:21 +0000 Received: by mail-vc0-f179.google.com with SMTP id gb23so5442376vcb.24 for ; Wed, 20 Feb 2013 20:41:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=QUUiiJsbpbBfosLgivk8gv55kP9W+SrfPtyPQeeBijs=; b=Yh1klzadSNJUmIRhYQps9dPQh3NN9xYXTz/Fi/JWQ/arRCK0ylHB0kLD9KIu3Q0GS5 3SoCI2TBNHHQLn7jIClIL595KL5KPl7JsggfzPXpGlozsYNbBOS68U+5xu8UeMzcVdPY tfpXhWZyyjSTfOs0EfhtW1obDSsVwj9LlYidqDpOP3eeLeU0AnolQd43Oy4xV/7ZTNXP 64uZGI/s3//xlB3yJFfm9P0FfBTsbS7UMuoREwWQgJnBVCweWUan3wvwRNK0pWNJkj2A 9M4kK84u3UUZUTjDK5zzyzMY3q/TvWnOQg2wHb3b4miiSXmfz8NfHkLscmYv9kH9X9KN a8Mg== MIME-Version: 1.0 X-Received: by 10.220.150.136 with SMTP id y8mr28926454vcv.34.1361421661150; Wed, 20 Feb 2013 20:41:01 -0800 (PST) Received: by 10.58.172.34 with HTTP; Wed, 20 Feb 2013 20:41:01 -0800 (PST) Received: by 10.58.172.34 with HTTP; Wed, 20 Feb 2013 20:41:01 -0800 (PST) In-Reply-To: <4FCA39B99132DA4EA70BE3CE408C193D0119F0E8F01D@BANPMAILBOX01.citrite.net> References: <35F04D4C394874409D9BE4BF45AC5EA9010F3B2BC0F8@BANPMAILBOX01.citrite.net> <8C261DB050CCFF47A271694F522ECF94ED9042@FTLPEX01CL01.citrite.net> <4FCA39B99132DA4EA70BE3CE408C193D0119F0E8F01D@BANPMAILBOX01.citrite.net> Date: Wed, 20 Feb 2013 21:41:01 -0700 Message-ID: Subject: RE: [DISCUSS] Management Server Memory Requirements From: Marcus Sorensen To: cloudstack-dev@incubator.apache.org Content-Type: multipart/alternative; boundary=f46d043d64b380a81404d634aeb7 X-Virus-Checked: Checked by ClamAV on apache.org --f46d043d64b380a81404d634aeb7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thanks. Looks like test servers are 1GB. And there is swapping. Can you run "vmstat 1" and give us 30 seconds of output? So we need to decide as a dev team if we need to raise minimum requirements and/or lower java process memory according to what new 4.1 code can get away with. On Feb 20, 2013 9:27 PM, "Sailaja Mada" wrote: > Hi, > > Cloudstack Java process statistics are given below when it stops > responding are given below : > > top - 09:52:03 up 4 days, 21:43, 2 users, load average: 0.06, 0.05, 0.0= 2 > Tasks: 1 total, 0 running, 1 sleeping, 0 stopped, 0 zombie > Cpu(s): 1.7%us, 0.7%sy, 0.0%ni, 97.3%id, 0.3%wa, 0.0%hi, 0.0%si, > 0.0%st > Mem: 1014860k total, 947632k used, 67228k free, 5868k buffers > Swap: 2031608k total, 832320k used, 1199288k free, 26764k cached > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 12559 cloud 20 0 3159m 744m 4440 S 2.3 75.1 6:38.39 java > > Thanks, > Sailaja.M > > -----Original Message----- > From: Marcus Sorensen [mailto:shadowsor@gmail.com] > Sent: Thursday, February 21, 2013 9:35 AM > To: cloudstack-dev@incubator.apache.org > Subject: Re: [DISCUSS] Management Server Memory Requirements > > Yes, these are great data points, but so far nobody has responded on that > ticket with the information required to know if the slowness is related t= o > memory settings or swapping. That was just a hunch on my part from being = a > system admin. > > How much memory do these systems have that experience issues? What does > /proc/meminfo say during the issues? Does adjusting the tomcat6.conf memo= ry > settings make a difference (see ticket comments)? How much memory do the > java processes list as resident in top? > On Feb 20, 2013 8:53 PM, "Parth Jagirdar" > wrote: > > > +1 Performance degradation is dramatic and I too have observed this > issue. > > > > I have logged my comments into 1339. > > > > > > =C5=A0Parth > > > > On 2/20/13 7:34 PM, "Srikanteswararao Talluri" > > wrote: > > > > >To add to what Marcus mentioned, > > >Regarding bug CLOUDSTACK-1339 : I have observed this issue within > > >5-10 min of starting management server and there has been a lot of > > >API requests through automated tests. It is observed that Management > > >server not only slows down but also goes down after a while. > > > > > >~Talluri > > > > > >-----Original Message----- > > >From: Marcus Sorensen [mailto:shadowsor@gmail.com] > > >Sent: Thursday, February 21, 2013 7:22 > > >To: cloudstack-dev@incubator.apache.org > > >Subject: [DISCUSS] Management Server Memory Requirements > > > > > >When Javelin was merged, there was an email sent out stating that > > >devs should set their MAVEN_OPTS to use 2g of heap, and 512M of > > >permanent memory. Subsequently, there have also been several e-mails > > >and issues where devs have echoed this recommendation, and presumably > > >it fixed issues. I've seen the MS run out of memory myself and > > >applied those recommendations. > > > > > >Is this what we want to provide in the tomcat config for a package > > >based install as well? It's effectively saying that the minimum > > >requirements for the management server are something like 3 or 4 GB > > >(to be safe for other running tasks) of RAM, right? > > > > > >There is currently a bug filed that may or may not have to do with > > >this, CLOUDSTACK-1339. Users report mgmt server slowness, going > > >unresponsive for minutes at a time, but the logs seem to show > > >business as usual. User reports that java is taking 75% of RAM, > > >depending on what else is going on they may be swapping. Settings in > > >the code for an install are currently at 2g/512M, I've been running > > >this on a 4GB server for awhile now, java is at 900M, but I haven't > > >been pounding it with requests or anything. > > > > > >This bug might not have anything to do with the memory settings, but > > >I figured it would be good to nail down what our minimum requirements > > >are for 4.1 > > > > > --f46d043d64b380a81404d634aeb7--