Mailing-List: contact users-help@trafficserver.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@trafficserver.apache.org
Received-SPF: pass (athena.apache.org: domain of pranavadesai@gmail.com
 designates 74.125.82.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=vAIYddLtnPSku4eAc4rY2wBAKg+3rbclJufzbhWqdgKyhZRynlUE0DQJXUmgGVKFRc
         Jz85UcVTRNUKLSDILNJeEjuZHTA7soWVMNTvc+JoDM+3PXzlKs/gnUfQ55tZtS1SHxjo
         8pgCZQp98feKWnTNGzfn70EAWW3JesFrmGDVY=
MIME-Version: 1.0
In-Reply-To: <4C937CB7.6070906@apache.org>
References: <AANLkTimv=F=xfSJBQ1EaSQ9Zx4qbjQyzkXJ5GFkkSghh@mail.gmail.com>
	<4C92C6B5.1070909@apache.org>
	<AANLkTikJZ7TV5sURYCbcFagGtQB3ncL7hvVz8boi23dN@mail.gmail.com>
	<4C92D935.3000406@apache.org>
	<4C937CB7.6070906@apache.org>
Date: Fri, 17 Sep 2010 09:41:06 -0700
Message-ID: <AANLkTim9nWnTNEQy93DoNMxS_QzixRMYBzws-ah9vS=U@mail.gmail.com>
Subject: Re: Need some help tuning for large file performance
From: Pranav Desai <pranavadesai@gmail.com>
To: users@trafficserver.apache.org, jplevyak@apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Fri, Sep 17, 2010 at 7:35 AM, John Plevyak <jplevyak@apache.org> wrote:
> I just added a new option (and default) for large files to
> the SVN repository. =A0 This dramatically improves performance
> of large files, particularly on configurations with fewer
> disks.

What is the option ?

>
> I have tried to repro the crash issue with large files and
> large ram disk to no avail.
>
> If you could try out the SVN version and make available
> your testing procedure so that I can reproduce the issue
> it would really help to get a fix.
>

I will try with the 2.1.2 version again to recheck if I screwed up
something and see if I can reproduce it with the SVN version.

I will create and update a thread for this issue on the dev list.

-- Pranav

> john
>
> On 9/16/2010 7:57 PM, Leif Hedstrom wrote:
>> =A0On 09/16/2010 08:09 PM, Pranav Desai wrote:
>>> On
>>> Done. Using 2 disks. Do you recommend a raid config for better
>>> performance ?
>>
>> No, I recommend RAID only if you really, really care for redundancy /
>> reliability. ATS will automatically "load balance" across any disks that
>> you throw at it.
>>
>>>
>>> Here are my tcp mem parameters. And req/sec isnt of concern here so I
>>> should be ok with the listen queue and backlogs. If you have any
>>> particular setting in mind please let me know.
>>>
>>> net.ipv4.tcp_mem =3D 1339776 =A0 =A0 =A01786368 2679552
>>> net.ipv4.tcp_wmem =3D 4096 =A0 =A0 =A0 =A087380 =A0 8388608
>>> net.ipv4.tcp_rmem =3D 4096 =A0 =A0 =A0 =A087380 =A0 8388608
>>
>> These would only make a difference if there's a latency between the
>> client and the server (which is generally not the case in a "lab"). =A0T=
he
>> above are for the autoscaling window sizes I think, which seem
>> reasonable. There are settings in records.config to bump up the initial
>> window size for the connections:
>>
>> CONFIG proxy.config.net.sock_send_buffer_size_in INT 262144
>> CONFIG proxy.config.net.sock_recv_buffer_size_in INT 0
>> CONFIG proxy.config.net.sock_send_buffer_size_out INT 0
>> CONFIG proxy.config.net.sock_recv_buffer_size_out INT 0
>>
>>
>> You definitely want to tune that mmap setting I mentioned earlier, and a
>> few other interesting sysctl's would be
>>
>> =A0 =A0 net.ipv4.tcp_max_syn_backlog (set it pretty high)
>> =A0 =A0 net.core.somaxconn
>> =A0 =A0 net.ipv4.tcp_syncookies (enable it)
>> =A0 =A0 net.ipv4.ip_local_port_range
>> =A0 =A0 net.ipv4.tcp_ecn (probably want it disabled)
>> =A0 =A0 net.ipv4.tcp_max_tw_buckets (increase for lots of sockets I thin=
k)
>>
>>
>>>
>>> I think I can reproduce it but under load, so it might be a bit
>>> difficult to debug it especially with all the threads. I will try to
>>> get to a simpler test case to reproduce it. Maybe I can run
>>> traffic_server alone with a single network and io thread ? How do you
>>> guys normally debug it ?
>>
>>
>> I think we should move the discussions related to this crasher problem
>> to the dev@trafficserver.apache.org mailing list (information how to
>> subscribe to it is on http://trafficserver.apache.org). There's a wider
>> crowd there that might be able to help as well, in particular John
>> Plevyak knows the cache better than anyone else on the planet.
>>
>> That much said, if you can reproduce it with restrictions like you
>> mention, that'll certainly help. Or, just describe how to setup the
>> environment, and what "load" to send to it, that might also help. But
>> the more you can limit the parameters / tests / time necessary to
>> reproduce it, the better.
>>
>> Thanks!
>>
>> -- leif
>
>