trafficserver-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sudheer Vinukonda <>
Subject Re: partial object caching
Date Thu, 06 Aug 2015 15:43:36 GMT
Background Fetch plugin takes care of that issue for you and won't allow more than one download
for the same object (cache key) at a time. We use that in production (and I think/know a few
other significant deployments do as well) and don't see any issues with fd exhaustion or multiple
downloads for the same file.
The only drawback (if you can call it so) with the solution is that, you may potentially waste
bandwidth/cache space for a really large object which may not be requested by clients often.

     On Thursday, August 6, 2015 8:24 AM, Madhava Gaikwad (madgaikw) <>

 #yiv9500072116 #yiv9500072116 -- _filtered #yiv9500072116 {font-family:Calibri;panose-1:2
15 5 2 2 2 4 3 2 4;} _filtered #yiv9500072116 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4
4 2 4;} _filtered #yiv9500072116 {panose-1:0 0 0 0 0 0 0 0 0 0;}#yiv9500072116 #yiv9500072116
p.yiv9500072116MsoNormal, #yiv9500072116 li.yiv9500072116MsoNormal, #yiv9500072116 div.yiv9500072116MsoNormal
{margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv9500072116 a:link, #yiv9500072116
span.yiv9500072116MsoHyperlink {color:blue;text-decoration:underline;}#yiv9500072116 a:visited,
#yiv9500072116 span.yiv9500072116MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv9500072116
p.yiv9500072116msolistparagraph, #yiv9500072116 li.yiv9500072116msolistparagraph, #yiv9500072116
div.yiv9500072116msolistparagraph {margin-right:0in;margin-left:0in;font-size:12.0pt;}#yiv9500072116
p.yiv9500072116msonormal, #yiv9500072116 li.yiv9500072116msonormal, #yiv9500072116 div.yiv9500072116msonormal
{margin-right:0in;margin-left:0in;font-size:12.0pt;}#yiv9500072116 p.yiv9500072116msochpdefault,
#yiv9500072116 li.yiv9500072116msochpdefault, #yiv9500072116 div.yiv9500072116msochpdefault
{margin-right:0in;margin-left:0in;font-size:12.0pt;}#yiv9500072116 span.yiv9500072116msohyperlink
{}#yiv9500072116 span.yiv9500072116msohyperlinkfollowed {}#yiv9500072116 span.yiv9500072116emailstyle17
{}#yiv9500072116 p.yiv9500072116msonormal1, #yiv9500072116 li.yiv9500072116msonormal1, #yiv9500072116
div.yiv9500072116msonormal1 {margin:0in;margin-bottom:.0001pt;font-size:11.0pt;}#yiv9500072116
span.yiv9500072116msohyperlink1 {color:blue;text-decoration:underline;}#yiv9500072116 span.yiv9500072116msohyperlinkfollowed1
{color:purple;text-decoration:underline;}#yiv9500072116 p.yiv9500072116msolistparagraph1,
#yiv9500072116 li.yiv9500072116msolistparagraph1, #yiv9500072116 div.yiv9500072116msolistparagraph1
span.yiv9500072116emailstyle171 {color:windowtext;}#yiv9500072116 p.yiv9500072116msochpdefault1,
#yiv9500072116 li.yiv9500072116msochpdefault1, #yiv9500072116 div.yiv9500072116msochpdefault1
{margin-right:0in;margin-left:0in;font-size:12.0pt;}#yiv9500072116 span.yiv9500072116EmailStyle29
{color:#1F497D;}#yiv9500072116 .yiv9500072116MsoChpDefault {font-size:10.0pt;} _filtered #yiv9500072116
{margin:1.0in 1.0in 1.0in 1.0in;}#yiv9500072116 div.yiv9500072116WordSection1 {}#yiv9500072116
Thanks Sudhir for the response. If too many clients starts doing range requests or even a
single client starts sending multiple range requests, using background fetch, may cause multiple
downloads to start, reason being downloads will not be sharable. Keeping rest of the client
connection  idle till, first download completes also not useful as it may cause FD exhaustion
for smaller footprint devices. I may be talking too much without knowing much about implementation
details.    Thank you. Madhava    From: Sudheer Vinukonda []
Sent: Thursday, August 06, 2015 8:36 PM
Subject: Re: partial object caching    As of v6.0, ATS does not support Partial object caching
(ala byte range caching).    However, ATS does support returning partial byte range responses
if the whole object is already cached.Background Fetch plugin takes advantage of this fact,
by initiating a full object download in the background on receiving a byte range request for
an object that's not in the cache yet. Once the full object is downloaded and populated into
the cache, subsequent byte range requests are directly served from the cache.       Thanks,
   Sudheer       On Thursday, August 6, 2015 12:34 AM, Madhava Gaikwad (madgaikw) <>
wrote:    Hello experts,   I have legacy forward proxy used in enterprise network facing
to internet behind firewall. Unfortunately it cannot do partial object caching. I am looking
if I can get an alternate proxy to do this. My requirement is: 1.      Partial object
caching so updates by apple etc. can be cached. Also video caching will just work. 2.      Streaming
to multiple client at same time should be possible from single server connection.   It seems
varnish can do above stuff. But it works effectively as reverse proxy, so I have to position
it before my proxy, as it cannot work as upstream proxy directly. Also its cache seems gets
vanished after restart(Everything in cache is from heap). Do you guys know if ATS can do this
functionality? I believe it is not possible, but I thought just ask if we achieve this by
any means. A pointing to how to would be really appreciated.     Thank you from Newbie,

View raw message