Return-Path: X-Original-To: apmail-trafficserver-users-archive@www.apache.org Delivered-To: apmail-trafficserver-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7BBF210B04 for ; Sat, 15 Nov 2014 05:36:11 +0000 (UTC) Received: (qmail 63520 invoked by uid 500); 15 Nov 2014 05:36:10 -0000 Delivered-To: apmail-trafficserver-users-archive@trafficserver.apache.org Received: (qmail 63462 invoked by uid 500); 15 Nov 2014 05:36:10 -0000 Mailing-List: contact users-help@trafficserver.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@trafficserver.apache.org Delivered-To: mailing list users@trafficserver.apache.org Received: (qmail 63452 invoked by uid 99); 15 Nov 2014 05:36:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Nov 2014 05:36:10 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ming.zym@gmail.com designates 209.85.220.49 as permitted sender) Received: from [209.85.220.49] (HELO mail-pa0-f49.google.com) (209.85.220.49) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 15 Nov 2014 05:35:43 +0000 Received: by mail-pa0-f49.google.com with SMTP id lj1so18585133pab.8 for ; Fri, 14 Nov 2014 21:35:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:message-id:mime-version:subject:date:references :to:in-reply-to; bh=lxlDa7SmdcipC+O8nz3XBxiKLEAEiHaSggi1WlVxmb0=; b=Q63wYcZ+7LUlV687I0oF1s0V3+I5zEVBkd98Id3r15b7/Y2EHvj39U9VM4AfjDojtZ W+TCp6DzwlN6LwFIW5iHNVkQb+3whyyrNUlimdew4wylaPwALpk896cMlh2Va5iUSfZf dnT9zDrZUZjNqnhWaerI9XmDyGtI+CyeRdg58RXJIkwZuK4a9dzstW9rgPRVda/VkcJb 4b3Iu8/409kFCrytG+VKrSXVyaPiFENKigWH/z/oMtJxvb4SKOrC2K1bCfld7/cyKrrB +LL8nQ9jQ2IoET5l7nW7QqQmk7rHMWCLZInidlCmK8yOCKkEVuojC9Ppa/rXv7c0sFqQ t2gw== X-Received: by 10.66.157.101 with SMTP id wl5mr14760533pab.37.1416029741954; Fri, 14 Nov 2014 21:35:41 -0800 (PST) Received: from [192.168.1.4] ([114.248.221.216]) by mx.google.com with ESMTPSA id bl3sm531713pbb.66.2014.11.14.21.35.37 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 14 Nov 2014 21:35:40 -0800 (PST) From: Yongming Zhao Content-Type: multipart/alternative; boundary="Apple-Mail=_B0E3B7B9-7B8F-4D8B-804D-FB2B1CE1C630" Message-Id: <29DC1F4F-CF9C-455E-98DE-53A6F5E87204@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 8.0 \(1990.1\)) Subject: Re: proxy.config.cache.ram_cache.size query from eBay Date: Sat, 15 Nov 2014 13:35:31 +0800 References: <6C3FE60A54A2274F8668094C2D9556B66E821648@PHX-EXRDA-S92.corp.ebay.com> <6C3FE60A54A2274F8668094C2D9556B66E822442@PHX-EXRDA-S92.corp.ebay.com> To: users@trafficserver.apache.org In-Reply-To: <6C3FE60A54A2274F8668094C2D9556B66E822442@PHX-EXRDA-S92.corp.ebay.com> X-Mailer: Apple Mail (2.1990.1) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_B0E3B7B9-7B8F-4D8B-804D-FB2B1CE1C630 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=gb2312 there is a blog in Chinese by =D9=DA=D4=A8, which may help you calculate = the memory needed by ATS: https://blog.zymlinux.net/index.php/archives/1038 = well, you have big storage, then you want to cache big files? if so, = please increase the average size, that will help reduce the index = memory. FYI - Yongming Zhao =D5=D4=D3=C0=C3=F7 > =D4=DA 2014=C4=EA11=D4=C215=C8=D5=A3=AC=C9=CF=CE=E710:32=A3=ACLerner, = Steve =D0=B4=B5=C0=A3=BA >=20 > James, > =20 > Makes perfect sense- thanks! In the mix of ye olde alchemy are there = any favorite levers to pull for ATS that are known to impact overall RAM = use? > =20 > We won=A1=AFt bother the list anymore about this after this question J = Thanks for the help! > =20 > -Steve > =20 > Steve Lerner | Sr. Member of Technical Staff, Network Engineering | M = 212 495 9212 | slerner@ebay.com | Skype: = steve.lerner > > =20 > From: James Peach [mailto:jpeach@apache.org]=20 > Sent: Friday, November 14, 2014 7:07 PM > To: users@trafficserver.apache.org > Subject: Re: proxy.config.cache.ram_cache.size query from eBay > =20 >=20 >=20 > On Nov 13, 2014, at 6:40 PM, Lerner, Steve > wrote: >=20 > Hi gang- Phil Sorber referred me to this list. > =20 > We are setting up clusters of Apache Traffic Server to beef up the = front end of our image services which are=A1=AD large in terms of = volume=A1=AD to say the least. > We hope to be the big users of ATS and be a strong reference customer- = so any help with is appreciated! > Our first test cluster consistes of 23 machines, ubuntu12.04, Intel(R) = 2x Xeon(R) CPU E5-2670 v2 @ 2.50GHz, 128G ram, 95T disk > =20 > Here is our query: > =20 > We are setting records.config as: CONFIG = proxy.config.cache.ram_cache.size INT 64G > =20 > But we find that trafficserver ignores this limit and grows at the = default rate of 1MB RAM / 1GB disk. > =20 > proxy.config.cache.ram_cache.size just sets how much memory to use in = the RAM cache, as YongMing points out, there's lots of other things in = the system that will consume RAM. Unfortunately tuning the RAM usage = seems to be a bit of a black art :-/ >=20 >=20 > =20 > Example of a current process:=20 > =20 > traffic_line -r proxy.config.cache.ram_cache.size returns = 68,719,476,736 > Which is about 64GB- correct! >=20 > But looking at the process: > =20 > 86050 nobody 20 0 108g 102g 4912 S 54 81.3 1523:33 = /ebay/local/trafficserver/bin/traffic_server -M --httpport 80:fd=3D7 > =20 > So basically we=A1=AFve set the process to only consume 64GB but its = consuming 108GB=A1=AD >=20 > Does anyone have any ideas on why this happens or a way to fix it? > We want to have constrained RAM but tons of disk- we=A1=AFd much = rather have the cache serve from disk then start swapping RAM > =20 > Thanks in advance, > =20 > Steve > =20 > Steve Lerner | Sr. Member of Technical Staff, Network Engineering | M = 212 495 9212 | slerner@ebay.com | Skype: = steve.lerner > --Apple-Mail=_B0E3B7B9-7B8F-4D8B-804D-FB2B1CE1C630 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=gb2312 there is a blog in Chinese by =D9=DA=D4=A8, which may help = you calculate the memory needed by ATS:
 https://blog.zymlinux.net/index.php/archives/1038

well, you have big = storage, then you want to cache big files? if so, please increase the = average size, that will help reduce the index memory.

FYI


- Yongming Zhao =D5=D4=D3=C0=C3=F7

=D4=DA 2014=C4=EA11=D4=C215=C8=D5=A3=AC=C9=CF=CE=E710:32=A3=ACL= erner, Steve <slerner@ebay.com> =D0=B4=B5=C0=A3=BA

James,
 
Makes perfect sense- = thanks! In the mix of ye olde alchemy are there any favorite levers to = pull for ATS that are known to impact overall RAM use?
 
We won=A1=AFt bother = the list anymore about this after this question J Thanks for the help!
 
-Steve
 
Steve Lerner | Sr. Member of Technical = Staff, Network Engineering | M 212 495 9212 | slerner@ebay.com | Skype: steve.lerner
<image001.jpg>
 
From: James Peach [mailto:jpeach@apache.org] 
Sent: Friday, November 14, 2014 = 7:07 PM
To: users@trafficserver.apache.org
Subject: Re: = proxy.config.cache.ram_cache.size query from eBay
 


On Nov 13, 2014, at 6:40 PM, Lerner, = Steve <slerner@ebay.com> = wrote:

Hi gang- Phil Sorber referred me to = this list.
 
We are setting up clusters = of Apache Traffic Server to beef up the front end of our image services = which are=A1=AD large in terms of volume=A1=AD to say the least.
We hope to be the big users of ATS and be a strong reference = customer- so any help with is appreciated!
Our first test = cluster consistes of 23 machines, ubuntu12.04, Intel(R) 2x Xeon(R) CPU = E5-2670 v2 @ 2.50GHz, 128G ram, 95T disk
 
Here is our query:
 
We are = setting records.config as: CONFIG proxy.config.cache.ram_cache.size = INT 64G
 
But we find that = trafficserver ignores this limit and grows at the default rate of 1MB = RAM / 1GB disk.
 
proxy.config.cache.ram_cache.size just sets how much = memory to use in the RAM cache, as YongMing points out, there's lots of = other things in the system that will consume RAM. Unfortunately tuning = the RAM usage seems to be a bit of a black art :-/


 
Example of a current = process: 
 
traffic_line -r = proxy.config.cache.ram_cache.size returns 68,719,476,736
Which is about 64GB- correct!

But = looking at the process:
 
86050 nobody =    20   0  108g 102g 4912 S   54 81.3 =   1523:33 /ebay/local/trafficserver/bin/traffic_server -M = --httpport 80:fd=3D7
 
So basically = we=A1=AFve set the process to only consume 64GB but its consuming = 108GB=A1=AD

Does anyone have any ideas on = why this happens or a way to fix it?
We want to have = constrained RAM but tons of disk- we=A1=AFd much rather have the cache = serve from disk then start swapping RAM
 
Thanks in advance,
 
Steve
 
Steve Lerner | Sr. Member of = Technical Staff, Network Engineering | M 212 495 9212 | slerner@ebay.com | = Skype: steve.lerner
<image001.jpg>

= --Apple-Mail=_B0E3B7B9-7B8F-4D8B-804D-FB2B1CE1C630--