Mailing-List: contact dev-help@httpd.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@httpd.apache.org
Received-SPF: error (idunn.apache.osuosl.org: domain acc.umu.se from
 130.239.18.156 cause and error)
Date: Thu, 21 Sep 2006 11:37:32 +0200 (MEST)
From: Niklas Edmundsson <nikke@acc.umu.se>
To: dev@httpd.apache.org
Subject: Re: mod_cache responsibilities vs mod_xxx_cache provider          
 responsibilities
In-Reply-To: <16655.196.8.104.37.1158831011.squirrel@www.sharp.fm>
Message-ID: <Pine.GSO.4.64.0609211131460.13149@kleopatra.acc.umu.se>
References: <45085C32.7070603@beamartyr.net>      
 <0A36A991-68A8-4F16-A876-07FA6BD18D16@haxent.com.br>      
 <Pine.GSO.4.64.0609140901330.20100@kleopatra.acc.umu.se>      
 <450AEB58.6050604@turner.com>
       <Pine.GSO.4.64.0609160827300.1603@kleopatra.acc.umu.se>
       <450DB44A.2070408@sharp.fm> <45114330.5060000@beamartyr.net>      
 <45115DF4.5030706@turner.com>
    <22319.196.8.104.37.1158767539.squirrel@www.sharp.fm>
    <4511881A.7030102@beamartyr.net> <45119B6D.7050404@apache.org>
 <16655.196.8.104.37.1158831011.squirrel@www.sharp.fm>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed

On Thu, 21 Sep 2006, Graham Leggett wrote:

> Hmmm - this affects the case where another process/thread is delivering
> from a still-being-cached entity.
>
> If the lead thread decides to stop, and other threads are following, the
> other following threads will deliver CacheMaxFileSize data, and cut the
> request short.
>
> One workaround for this problem is to have following threads ignore the
> cached entity if the entity does not have a content length - something the
> entity will have when caching is complete.
>
> This means the backend server will still see a spike of traffic while the
> object is being cached, but the cache will no try and cache multiple
> entities until the first one wins, which happens now.

Our patch solves this by pausing read-threads while the object is 
being cached until there is a known length of the body, with a timeout 
to detect if the caching thread has died. Drawback is that you have to 
write the header twice, but that's cheap compared to caching an object 
N times. Seems to do the trick, but it haven't had nearly as much 
pounding as the cache-from-file case (the main use is on a ftp server, 
remember).

/Nikke - currently working on getting a machine up for testing
          the smaller patches before submitting them.
-- 
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  Niklas Edmundsson, Admin @ {acc,hpc2n}.umu.se | nikke@acc.umu.se 
---------------------------------------------------------------------------
  The dog ate my .REP packet.
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=