httpd-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian Akins <bak...@web.turner.com>
Subject Re: [PATCH] mod_disk cached fixed
Date Thu, 05 Aug 2004 12:37:09 GMT
Justin Erenkrantz wrote:

> -
> Disk space is cheap.  ;-)
>
> I think the vary header would still be preserved in the cached copy, 
> so I'm not sure how down-stream caches would be affected.  -- justin
>

Here are some interesting stats from a large new site:

Sample time of 6 hours => 1,039,361 hits from a single box

20,493 distinct User-Agents

Here's the top few:
152260: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
127111: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
117145: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 
1.1.4322)
43571: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)
37977: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 1.0.3705)
30698: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
29425: -
25695: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 
1.0.3705; .NET CLR 1.1.4322)
20288: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0)
15862: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request
13413: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.0.3705)
11447: Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
11172: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 4.0)
10759: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.4) 
Gecko/20030624 Netscape/7.1 (ax)
10264: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 
1.0.3705; .NET CLR 1.1.4322)
8743: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; T312461)
7710: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)
6635: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0; T312461)
5938: Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en) AppleWebKit/125.2 
(KHTML, like Gecko) Safari/125.8
5539: Mozilla/4.0 (compatible; MSIE 6.0; Windows 98; Win 9x 4.90)
5487: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Q312461)
5327: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts)
5269: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; Q312461)
5156: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) 
Gecko/20030624 Netscape/7.1 (ax)
5019: Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/125.2 
(KHTML, like Gecko) Safari/125.8
5014: Mozilla/3.01 (compatible;)

 

So, if you varied simple on the value of User-Agent, you wind up with 
more than a dozen or so entries for each "object."  Disk space isn't the 
proble, it's that you would have to regenerate each object for each 
User-Agent.  Coupl this with varying on accepting encoding, and it grows 
somewhate larger.  In some instances it may take a few database queries 
and parsing to produce the page.  Besides the regex is not that 
expensive, in my tests, its in 11th place.

-- 
Brian Akins
Senior Systems Engineer
CNN Internet Technologies


Mime
View raw message