jakarta-jcs-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matthew Cooke <mpcoo...@lineone.net>
Subject Additional problems.
Date Sun, 25 Apr 2004 11:22:47 GMT
The original problem was that the removal code was commented out in the src.
Then I needed to change the code to use keys for removal (I believe this 
is already fixed in your latest version)
Finally the remotecache.ccf file had the client call back port commented 
out in the example.

We have now run the Cache for 2 days with fairly high put/get volumes in 
a production enviroment with 2 machines doing puts and 12 machines doing 
gets.

The whole solution falls over after a couple days with Out Of Memorys 
and the remotecache needs restarting. the 12 machines all started 
running slowly and retrieval from JCS was not returning valid contents. 
Apache also then started backlogging causing every machine to go tits up.

The data we are caching comes to about 10Meg maybe 20 at most and the 
remotecache was running with 350Meg memory!

I noticed in your example you had given the remotecache 1.8gigs ram. Is 
this because you were storing more data, because JCS is very inefficient 
or due to a leak?
Now I have 12 machines connected to the remote cache does it require 12x 
the memory?

Wearily,
Matt
PS Up at 8.30am on a sunday restarting servers.


Travis Savo wrote:

>Your cache.ccf looks fine. 
>
>If I understand you correctly, the problem is the original put works fine,
>but subsequent puts for that same region/key don't update the object
>remotely, correct?
>
>I'll have to test this scenario locally and get back to you.
>
>Writing unit tests for remote cache has been rapidly approaching the top of
>my todo stack, and this may bump it up another notch, depending on what the
>rest of my work load is like.
>
>Things to try right off the bat: Turn on logging. See the puts getting done
>to remote cache, and the removes getting broadcast from remote cache and
>received on the other clients? You should....
>
>-Travis Savo
>
>-----Original Message-----
>From: Matthew Cooke [mailto:mpcooke3@lineone.net]
>Sent: Monday, April 19, 2004 1:34 PM
>To: Turbine JCS Users List
>Subject: JCS remote cache problems
>
>
>Travis (or anyone else!),
>
>I'm having some problems with the remote cache implementation, it seems 
>that items aren't getting updated on the servers after a put is 
>performed on one machine.
>I'm not sure what the problem is, I've got a feeling only the first put 
>is working and I didn't notice because the cached content doesn't change 
>that fast in our system.
>
>This could be a bug in my usage of JCS or in the config file it may well 
>not be a bug in the improved JCS.
>What might cause items to not be deleted in the connected machines 
>caches when a new put occurs?
>
>Any ideas or suggestions much appreciated, I will be trying to reproduce 
>this problem back in testing again tomorrow!
>
>Kind Regards,
>Matt.
>
>PS Below I attach first the ccf file used by most machines and below 
>that the remote.ccf file used on the RemoteServer
>
>
>
># Normal config for MFN Production 
>servers
>
>
>##############################################################
>################## DEFAULT CACHE REGION  #####################
># sets the default aux value for any non configured caches
>jcs.default=DC,RC
>jcs.default.cacheattributes=org.apache.jcs.engine.CompositeCacheAttributes
>jcs.default.cacheattributes.MaxObjects=1000
>jcs.default.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memory.lru
>.LRUMemoryCache
>jcs.default.cacheattributes.UseMemoryShrinker=true
>jcs.default.cacheattributes.MaxMemoryIdleTimeSeconds=3600
>jcs.default.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.default.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.default.elementattributes=org.apache.jcs.engine.ElementAttributes
>jcs.default.elementattributes.IsEternal=false
>jcs.default.elementattributes.MaxLifeSeconds=7
>jcs.default.elementattributes.IdleTime=1800
>jcs.default.elementattributes.IsSpool=true
>jcs.default.elementattributes.IsRemote=true
>jcs.default.elementattributes.IsLateral=true
> 
>
>
># SYSTEM CACHE
># should be defined for the storage of group attribute list
>jcs.system.groupIdCache=DC,RC
>jcs.system.groupIdCache.cacheattributes=org.apache.jcs.engine.CompositeCache
>Attributes
>jcs.system.groupIdCache.cacheattributes.MaxObjects=10000
>jcs.system.groupIdCache.cacheattributes.MemoryCacheName=org.apache.jcs.engin
>e.memory.lru.LRUMemoryCache
>jcs.system.groupIdCache.elementattributes=org.apache.jcs.engine.ElementAttri
>butes
>jcs.system.groupIdCache.elementattributes.IsEternal=true
>jcs.system.groupIdCache.elementattributes.MaxLifeSeconds=3600
>jcs.system.groupIdCache.elementattributes.IdleTime=1800
>jcs.system.groupIdCache.elementattributes.IsSpool=true
>jcs.system.groupIdCache.elementattributes.IsRemote=true
>jcs.system.groupIdCache.elementattributes.IsLateral=true
> 
>
>
> 
>
>
>##############################################################
>################## CACHE REGIONS AVAILABLE ###################
># Regions preconfirgured for caching
> 
>
>
>jcs.region.primaryCache=DC,RC
>jcs.region.primaryCache.cacheattributes=org.apache.jcs.engine.CompositeCache
>Attributes
>jcs.region.primaryCache.cacheattributes.MaxObjects=4000
>jcs.region.primaryCache.cacheattributes.MemoryCacheName=org.apache.jcs.engin
>e.memory.lru.LRUMemoryCache
>jcs.region.primaryCache.cacheattributes.UseMemoryShrinker=true
>jcs.region.primaryCache.cacheattributes.MaxMemoryIdleTimeSeconds=10
>jcs.region.primaryCache.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.region.primaryCache.elementattributes=org.apache.jcs.engine.ElementAttri
>butes
>jcs.region.primaryCache.elementattributes.IsEternal=false
>jcs.region.primaryCache.elementattributes.MaxLifeSeconds=259200
>jcs.region.primaryCache.elementattributes.IsSpool=true
>jcs.region.primaryCache.elementattributes.IsRemote=true
>jcs.region.primaryCache.elementattributes.IsLateral=true
> 
>
>
>##############################################################
>################## AUXILIARY CACHES AVAILABLE ################
> 
>
>
># Disk Cache used as an overflow cache when the main memory cache is full.
>jcs.auxiliary.DC=org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCacheFacto
>ry
>jcs.auxiliary.DC.attributes=org.apache.jcs.auxiliary.disk.indexed.IndexedDis
>kCacheAttributes
>jcs.auxiliary.DC.attributes.DiskPath=/usr/local/web/jcscache
> 
>
>
># This is an RMI based remote cache.
>jcs.auxiliary.RC=org.apache.jcs.auxiliary.remote.RemoteCacheFactory
>jcs.auxiliary.RC.attributes=org.apache.jcs.auxiliary.remote.RemoteCacheAttri
>butes
>jcs.auxiliary.RC.attributes.RemoteHost=builder
>jcs.auxiliary.RC.attributes.RemotePort=1099
>jcs.auxiliary.RC.attributes.LocalPort=1103
>jcs.auxiliary.RC.attributes.RemoveUponRemotePut=false
>#jcs.auxiliary.RC.attributes.RemoteServiceName=RemoteCache
>
>
>
>-----------
>
>
>
>
>
># Config for MFN Central JCS server. 
> 
>
>
>##############################################################
>################## DEFAULT CACHE REGION  #####################
># Registry used to register and provide the
># IRemoteCacheService service.
>registry.host=localhost
>registry.port=1099
> 
>
>
> 
>
>
>##############################################################
>################## DEFAULT CACHE REGION  #####################
># sets the default aux value for any non configured caches
>jcs.default=DC
>jcs.default.cacheattributes=org.apache.jcs.engine.CompositeCacheAttributes
>jcs.default.cacheattributes.MaxObjects=1000
>jcs.default.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memory.lru
>.LRUMemoryCache
>jcs.default.cacheattributes.UseMemoryShrinker=true
>jcs.default.cacheattributes.MaxMemoryIdleTimeSeconds=3600
>jcs.default.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.default.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.default.elementattributes=org.apache.jcs.engine.ElementAttributes
>jcs.default.elementattributes.IsEternal=false
>jcs.default.elementattributes.MaxLifeSeconds=7
>jcs.default.elementattributes.IdleTime=1800
>jcs.default.elementattributes.IsSpool=true
>jcs.default.elementattributes.IsRemote=true
>jcs.default.elementattributes.IsLateral=true
> 
>
>
># SYSTEM CACHE
># should be defined for the storage of group attribute list
>jcs.system.groupIdCache=DC
>jcs.system.groupIdCache.cacheattributes=org.apache.jcs.engine.CompositeCache
>Attributes
>jcs.system.groupIdCache.cacheattributes.MaxObjects=10000
>jcs.system.groupIdCache.cacheattributes.MemoryCacheName=org.apache.jcs.engin
>e.memory.lru.LRUMemoryCache
>jcs.system.groupIdCache.elementattributes=org.apache.jcs.engine.ElementAttri
>butes
>jcs.system.groupIdCache.elementattributes.IsEternal=true
>jcs.system.groupIdCache.elementattributes.MaxLifeSeconds=3600
>jcs.system.groupIdCache.elementattributes.IdleTime=1800
>jcs.system.groupIdCache.elementattributes.IsSpool=true
>jcs.system.groupIdCache.elementattributes.IsRemote=true
>jcs.system.groupIdCache.elementattributes.IsLateral=true
> 
>
>
> 
>
>
>##############################################################
>################## CACHE REGIONS AVAILABLE ###################
># Regions preconfirgured for caching
> 
>
>
>jcs.region.primaryCache=DC
>jcs.region.primaryCache.cacheattributes=org.apache.jcs.engine.CompositeCache
>Attributes
>jcs.region.primaryCache.cacheattributes.MaxObjects=10
>jcs.region.primaryCache.cacheattributes.MemoryCacheName=org.apache.jcs.engin
>e.memory.lru.LRUMemoryCache
>jcs.region.primaryCache.cacheattributes.UseMemoryShrinker=true
>jcs.region.primaryCache.cacheattributes.MaxMemoryIdleTimeSeconds=10
>jcs.region.primaryCache.cacheattributes.ShrinkerIntervalSeconds=60
>jcs.region.primaryCache.elementattributes=org.apache.jcs.engine.ElementAttri
>butes
>jcs.region.primaryCache.elementattributes.IsEternal=false
>jcs.region.primaryCache.elementattributes.MaxLifeSeconds=60000
>jcs.region.primaryCache.elementattributes.IsSpool=true
>jcs.region.primaryCache.elementattributes.IsRemote=true
>jcs.region.primaryCache.elementattributes.IsLateral=true
> 
>
>
># Primary Disk Cache-- faster than the rest because of memory key storage
>jcs.auxiliary.DC=org.apache.jcs.auxiliary.disk.indexed.IndexedDiskCacheFacto
>ry
>jcs.auxiliary.DC.attributes=org.apache.jcs.auxiliary.disk.indexed.IndexedDis
>kCacheAttributes
>jcs.auxiliary.DC.attributes.DiskPath=/usr/local/web/MasterJcsCache
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: turbine-jcs-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: turbine-jcs-user-help@jakarta.apache.org
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: turbine-jcs-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: turbine-jcs-user-help@jakarta.apache.org
>
>  
>


---------------------------------------------------------------------
To unsubscribe, e-mail: turbine-jcs-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: turbine-jcs-user-help@jakarta.apache.org


Mime
View raw message