Return-Path: X-Original-To: apmail-trafficserver-users-archive@www.apache.org Delivered-To: apmail-trafficserver-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E733297FA for ; Fri, 13 Apr 2012 09:25:13 +0000 (UTC) Received: (qmail 71102 invoked by uid 500); 13 Apr 2012 09:25:13 -0000 Delivered-To: apmail-trafficserver-users-archive@trafficserver.apache.org Received: (qmail 70904 invoked by uid 500); 13 Apr 2012 09:25:13 -0000 Mailing-List: contact users-help@trafficserver.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@trafficserver.apache.org Delivered-To: mailing list users@trafficserver.apache.org Received: (qmail 70894 invoked by uid 99); 13 Apr 2012 09:25:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Apr 2012 09:25:13 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of iamrohit@gmail.com designates 209.85.212.42 as permitted sender) Received: from [209.85.212.42] (HELO mail-vb0-f42.google.com) (209.85.212.42) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Apr 2012 09:25:08 +0000 Received: by vbjk13 with SMTP id k13so2267540vbj.29 for ; Fri, 13 Apr 2012 02:24:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=k/vxBoXfjmhCmySJlOxMr4xJ/2koAR2sW8/8F9el3Uo=; b=j17GafotOG1BJjLnU/WaiyCwDo0t9zFa0m8Ti21Qv4moUiyxSp4LRuEFVGqtFqLxlh 7QlpasETwJY7ap/OBHY84FJJdFTWjRR1ZTOrFe7JsTDKFqECf8LVpGygGif6gf52lnmj vQvJFOqRLe0Km3PNEqfSh4dZ1FBaKvHgjVwW+1V+aydxG926HYo1dxF/J9SQiuOiwUe1 JkCNrx5pJ+gErBnIjALGi8UWHlBrMM+scH2E5bZz19T7vkf/v0wORXU8DU7HbXJsSFsw BrQqRhd/d+4Ht/NrwlPLK6XHg4M/q8ZRjrtoLIKstH+8L13xm9VhiXk5wdo8xrlpO1fx RQUA== MIME-Version: 1.0 Received: by 10.220.115.130 with SMTP id i2mr412609vcq.72.1334309087312; Fri, 13 Apr 2012 02:24:47 -0700 (PDT) Received: by 10.52.68.234 with HTTP; Fri, 13 Apr 2012 02:24:47 -0700 (PDT) In-Reply-To: <5BE3315B-80C1-4AC1-8A8A-7C7971C76F31@linux-it.es> References: <1334067402.13612.18.camel@zym6400> <4F8443EC.606@cable.comcast.com> <5FA76BD7-3605-419B-9D4C-A88F32AA09D5@linux-it.es> <47F0DC7D-3191-47AF-9E37-F449ED6216EE@linux-it.es> <5BE3315B-80C1-4AC1-8A8A-7C7971C76F31@linux-it.es> Date: Fri, 13 Apr 2012 14:54:47 +0530 Message-ID: Subject: Re: ATS concurrence From: Rohit Karlupia To: users@trafficserver.apache.org Content-Type: multipart/alternative; boundary=f46d042fdaec2b7a9a04bd8c0bcd X-Virus-Checked: Checked by ClamAV on apache.org --f46d042fdaec2b7a9a04bd8c0bcd Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable 1) What do you get for cat /proc/sys/net/ipv4/ip_local_port_range ? 2) Does the TPS decreases over time? Or is it consistent for long time? 3) Ab does report how many requests used keep alive connection. Check if that value is significant. ab uses HTTP 1.0, not sure if ATS supports keep-alive for http 1.0 connections. thanks! rohitk On Fri, Apr 13, 2012 at 1:53 PM, Jorge Rom=E1n Novalbos wrote: > The ATS is not going back to the server, but i have a lot of TIME_WAIT > connections between ATS and "ab client machine", around 3600 TIME_WAIT > connection of 4000. > > Any clue? > > > On 13/04/2012, at 09:28, Rohit Karlupia wrote: > > Can you verify that ATS is not going back to your servers? > Check netstat output on ATS machine? > - You should only have connections from client to ATS. > - Do you see connections in TIME_WAIT? How many? > > thanks! > rohitk > > > On Fri, Apr 13, 2012 at 12:47 PM, Jorge Rom=E1n Novalbos > wrote: > >> Hi, thank for your answer!! >> >> 1) I have tried with -k too, and i have timeouts too. >> >> 2)I don't think that was the problem because I get the same timeout from >> different clients from internet. anyway I have 10G internet conexion. >> >> 3) The ATS server load is very low during the test, never overcome 1. Th= e >> request never reach the origin servers because ATS is caching the object= , >> therefore the req per seconds should be much more high. >> 4) I have the same problem with statics objects. My origin servers never >> could handle 10000 req/s, therefore I'm interesting in ATS. >> 5) Sure! >> >> I don't know, but I think it's a problem (or setting) of the SO tcp/ip >> stack. >> >> Any other idea??? >> >> >> On 13/04/2012, at 08:34, Rohit Karlupia wrote: >> >> Multiple things can go wrong..;) >> >> 1) You can use -k option with ab to keep the client connections alive. >> That should be helpful. >> 2) Divide the total bytes transferred by duration of the test to see if >> you are close to bandwidth limits. (100Mbps or 1Gbps) >> 3) Are you maxing out on cpu on ATS or the application server machine? >> ATS is a proxy. It will only add to latency. If the backend server is >> exhausted, you probably need to put more servers and load balance them >> using ATS to get your desired numbers. >> 4) php is process based. What is behind ATS ? Apache? How many processes= ? >> 5) Are you using caching on ATS? >> >> thanks! >> rohitk >> >> On Fri, Apr 13, 2012 at 1:48 AM, Jorge Rom=E1n Novalbos > > wrote: >> >>> Hi everyone!! >>> >>> I'm configuring a new ATS machine that it gonna server a lot request pe= r >>> second (around 10000). >>> >>> I have done several benchmark with ab from different machine to achieve >>> more concurrence but I can't get more than 3000 request per second. >>> >>> I have set several params in order to improve the performance: >>> >>> echo "1" > /proc/sys/net/ipv4/tcp_tw_recycle >>> echo "1" > /proc/sys/net/ipv4/tcp_tw_reuse >>> echo "10" > /proc/sys/net/ipv4/tcp_fin_timeout >>> >>> echo "10240" > /proc/sys/net/core/somaxconn >>> >>> Besides, I have increased max open file allowed for nobody user to 1638= 4 >>> (User that run ATS) >>> >>> In the client side always get the same error : >>> >>> apr_socket_recv: Connection timed out (110) >>> >>> This is the ab command: >>> >>> ab -c 600 -t 60 ''http://172.20.10.11/test.php" >>> >>> I have increased the limit to 5000 in client side too. >>> >>> Anybody knows how i can retrieve more concurrence in my server?????? >>> >>> Thanks in advance!!! >>> >>> Jorge >> >> >> >> > > --f46d042fdaec2b7a9a04bd8c0bcd Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable 1) What do you get for cat =A0=A0/proc/sys/net/ipv4/ip_local_port_range ? =A0
2) Does the= TPS decreases over time? Or is it consistent for long time?=A0
3= ) Ab does report how many requests used keep alive connection. Check if tha= t value is significant. ab uses HTTP 1.0, not sure if ATS supports keep-ali= ve for http 1.0 connections.=A0

thanks!
rohitk

On Fri, Apr 13, 2012 at 1:53 PM, Jorge Rom=E1n Novalbos <jroman@linux-it.es> wrote:
The ATS = is not going back to the server, but i have a lot of TIME_WAIT connections = between ATS and "ab client machine", around 3600 TIME_WAIT connec= tion of 4000.

Any clue?

On 13/04/2012, at 09:28, Rohit Karlupia wrote:
<= br>
Can you verify that ATS is not going back to y= our servers?
Check netstat output on ATS machine?
=A0- You should only have connecti= ons from client to ATS.
=A0- Do you see connections in TIME_WAIT?=A0 Ho= w many?

thanks!
rohitk


On Fri, Apr 13, 201= 2 at 12:47 PM, Jorge Rom=E1n Novalbos <jroman@linux-it.es> = wrote:
Hi, =A0thank for your answer!!

=
1) I have tried with -k too, and i have timeouts too.
=
2)I don't think that was the problem because I get the s= ame timeout from different clients from internet. anyway I have 10G interne= t conexion.

3) The ATS server load is very low during the test, nev= er overcome 1. The request never reach the origin servers because ATS is ca= ching the object, therefore the req per seconds should be much more high.
4) I have the same problem with statics objects. My origin servers nev= er could handle 10000 req/s, therefore I'm interesting in ATS.
5) Sure!

I don't know, but I think it's = a problem (or setting) of the SO tcp/ip stack.

Any other idea???=A0


On 13/04/2012, at 08:34, Rohit Karlupia wrote:

Multiple things can go wrong..;)

1) You can use -k option with ab to keep the client connections alive.= That should be helpful.
2) Divide the total bytes=A0transferred = by duration of the test to see if you are close to bandwidth limits. (100Mb= ps or 1Gbps)=A0
3) Are you maxing out on cpu on ATS or the application server machine?= ATS is a proxy. It will only add to latency. If the backend server is exha= usted, you probably need to put more servers and load balance them using AT= S to get your desired numbers.
4) php is process based. What is behind ATS ? Apache? How many process= es?=A0
5) Are you using caching on ATS?=A0

thanks!
rohitk

On Fri, Apr 13, 2012 at 1:48 AM, Jorge Rom=E1n Novalbos &= lt;jroman@linux-it.= es> wrote:
Hi everyone!!

I'm configuring a new ATS machine that it gonna server a lot request pe= r second (around 10000).

I have done several benchmark with ab from different machine to achieve mor= e concurrence but I can't get more than 3000 request per second.

I have set several params in order to improve the performance:

echo "1" > /proc/sys/net/ipv4/tcp_tw_recycle
echo "1" > /proc/sys/net/ipv4/tcp_tw_reuse
echo "10" > /proc/sys/net/ipv4/tcp_fin_timeout

echo "10240" > /proc/sys/net/core/somaxconn

Besides, I have increased max open file allowed for nobody user to 16384 (U= ser that run ATS)

In the client side always get the same error :

apr_socket_recv: Connection timed out (110)

This is the ab command:

ab -c 600 -t 60 ''http://172.20.10.11/test.php"

I have increased the limit to 5000 in client side too.

Anybody knows how i can retrieve more concurrence in my server??????

Thanks in advance!!!

Jorge





--f46d042fdaec2b7a9a04bd8c0bcd--