Return-Path: Delivered-To: apmail-cocoon-dev-archive@www.apache.org Received: (qmail 49107 invoked from network); 22 Oct 2004 08:19:59 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur-2.apache.org with SMTP; 22 Oct 2004 08:19:59 -0000 Received: (qmail 84912 invoked by uid 500); 22 Oct 2004 08:19:36 -0000 Delivered-To: apmail-cocoon-dev-archive@cocoon.apache.org Received: (qmail 84808 invoked by uid 500); 22 Oct 2004 08:19:33 -0000 Mailing-List: contact dev-help@cocoon.apache.org; run by ezmlm Precedence: bulk list-help: list-unsubscribe: list-post: Reply-To: dev@cocoon.apache.org Delivered-To: mailing list dev@cocoon.apache.org Received: (qmail 84764 invoked by uid 99); 22 Oct 2004 08:19:31 -0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (hermes.apache.org: local policy) Received: from [62.140.213.123] (HELO pulse.betaversion.org) (62.140.213.123) by apache.org (qpsmtpd/0.28) with SMTP; Fri, 22 Oct 2004 01:19:29 -0700 Received: (qmail 20581 invoked from network); 22 Oct 2004 08:18:57 -0000 Received: from unknown (HELO ?10.11.155.45?) (pier@62.140.213.2) by pulse.betaversion.org with SMTP; 22 Oct 2004 08:18:57 -0000 Mime-Version: 1.0 (Apple Message framework v619) In-Reply-To: <41785582.5000506@reverycodes.com> References: <41785582.5000506@reverycodes.com> Content-Type: multipart/signed; micalg=sha1; boundary=Apple-Mail-1--133146176; protocol="application/pkcs7-signature" Message-Id: <05899AC1-2403-11D9-A4CE-000A95984AEA@betaversion.org> From: Pier Fumagalli Subject: Re: FilesystemStore broken??? Date: Fri, 22 Oct 2004 09:18:57 +0100 To: dev@cocoon.apache.org X-Mailer: Apple Mail (2.619) X-Virus-Checked: Checked X-Spam-Rating: minotaur-2.apache.org 1.6.2 0/1000/N --Apple-Mail-1--133146176 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed On 22 Oct 2004, at 01:34, Vadim Gritsenko wrote: > Corin Moss wrote: >> Hiya, >> This probably works for the FilesystemStore, but both the JCS and >> EHCache stores use their own store file - so everything is cached >> within >> one big binary file - which means that something else has to take over >> the deleting cycle. > > True. This thread though was about FS store :) > You'll have to monitor last access timestamp to implement similar for > jcs/ehcache/whatever. > > >> Also add to this that when you use event based >> caching you can't rely on time stamps - something could be 3 months >> old >> in the cache but still be valid. > > My point is; if it was not used in a week - you could easily delete it > and it will be re-created when it is needed next time. But if resource > is frequently accessed, then its access timestamp will be updated and > so it will not be removed. > > This approach should work just fine in 90% - or even 99% - of cases. > Think of it as an analogue to LRU cleanup policy, but with preset time > limit instead of preset cache size. > That's what I'm doing on the Apache side of things to actually wipe out the content of the cache after one day.... But now I kinda understand why JCS crashed on me after 6/8 hours being put on live... It's a grow-only mechanism, and given that I probably restart Cocoon on live once every 3/4 weeks (maybe longer) and we have something like 1.5 million valid URLs (150.000 articles on 11 sites), I can see why the baby can't handle it... Time to write some code, then... Pier --Apple-Mail-1--133146176 Content-Transfer-Encoding: base64 Content-Type: application/pkcs7-signature; name=smime.p7s Content-Disposition: attachment; filename=smime.p7s MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGHDCCAtUw ggI+oAMCAQICAwttIjANBgkqhkiG9w0BAQQFADBiMQswCQYDVQQGEwJaQTElMCMGA1UEChMcVGhh d3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNvbmFsIEZyZWVt YWlsIElzc3VpbmcgQ0EwHhcNMDQwMTA3MDE0MjIwWhcNMDUwMTA2MDE0MjIwWjBGMR8wHQYDVQQD ExZUaGF3dGUgRnJlZW1haWwgTWVtYmVyMSMwIQYJKoZIhvcNAQkBFhRwaWVyQGJldGF2ZXJzaW9u Lm9yZzCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMC/E+M4UqeEBnSTj0AIMX9oMWSo 9Te7VUPPvINPSKKLEElGaottQeJaYRSlfGIjUyXkzTlbw0MFAPaqfU97t+5xeNkighKu7ZcVIPfz AARv5+wp+gON5uSNV2GzP0rPwAbUDIG2zaSonJlN7whVG5fO9G1u0oYaWolpgKUAc3T5P5Gv737L G1iSxrnl9DQlVDIuZWrcgWYX/MFFlf7prXXm6lS08lYhGi0NrIf5SploZzMG+uHHzVDgV8WCTQr1 hXB825VLhnWw4GPFx5qLVgElctVz88S/+t8O/+1kRf3ky8SsewfyCTuDAk4XHzfb7M5bECiZ1yni dhW+sD1y/TsCAwEAAaMxMC8wHwYDVR0RBBgwFoEUcGllckBiZXRhdmVyc2lvbi5vcmcwDAYDVR0T AQH/BAIwADANBgkqhkiG9w0BAQQFAAOBgQAjeSEnk3U1P46rHiBGJP7StkQg/DVkw4ModEYCEwxm 8QYxQPGMciXn2goZ5ahK6Uu8Rfa+ZPSxV96VFsOlc3oFF02VYsrRy+xJukuSMY0z/0UvHnTZmVfm CJpxMoVMYQO3fC2XdmCNASu8FbvOgaS71fQf3b0wgebLeLROR7u5XjCCAz8wggKooAMCAQICAQ0w DQYJKoZIhvcNAQEFBQAwgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUxEjAQ BgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNVBAsTH0Nl cnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQZXJzb25hbCBG cmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxAdGhhd3RlLmNvbTAe Fw0wMzA3MTcwMDAwMDBaFw0xMzA3MTYyMzU5NTlaMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxU aGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJl ZW1haWwgSXNzdWluZyBDQTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAxKY8VXNV+065ypla HmjAdQRwnd/p/6Me7L3N9VvyGna9fww6YfK/Uc4B1OVQCjDXAmNaLIkVcI7dyfArhVqqP3FWy688 Cwfn8R+RNiQqE88r1fOCdz0Dviv+uxg+B79AgAJk16emu59l0cUqVIUPSAR/p7bRPGEEQB5kGXJg t/sCAwEAAaOBlDCBkTASBgNVHRMBAf8ECDAGAQH/AgEAMEMGA1UdHwQ8MDowOKA2oDSGMmh0dHA6 Ly9jcmwudGhhd3RlLmNvbS9UaGF3dGVQZXJzb25hbEZyZWVtYWlsQ0EuY3JsMAsGA1UdDwQEAwIB BjApBgNVHREEIjAgpB4wHDEaMBgGA1UEAxMRUHJpdmF0ZUxhYmVsMi0xMzgwDQYJKoZIhvcNAQEF BQADgYEASIzRUIPqCy7MDaNmrGcPf6+svsIXoUOWlJ1/TCG4+DYfqi2fNi/A9BxQIJNwPP2t4WFi w9k6GX6EsZkbAMUaC4J0niVQlGLH2ydxVyWN3amcOY6MIE9lX5Xa9/eH1sYITq726jTlEBpbNU13 41YheILcIRk13iSx0x1G/11fZU8xggLnMIIC4wIBATBpMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQK ExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwg RnJlZW1haWwgSXNzdWluZyBDQQIDC20iMAkGBSsOAwIaBQCgggFTMBgGCSqGSIb3DQEJAzELBgkq hkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA0MTAyMjA4MTg1OFowIwYJKoZIhvcNAQkEMRYEFF4p CYeBwdyP9m8yTi53v7VQt/wGMHgGCSsGAQQBgjcQBDFrMGkwYjELMAkGA1UEBhMCWkExJTAjBgNV BAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQZXJzb25h bCBGcmVlbWFpbCBJc3N1aW5nIENBAgMLbSIwegYLKoZIhvcNAQkQAgsxa6BpMGIxCzAJBgNVBAYT AlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3 dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBDQQIDC20iMA0GCSqGSIb3DQEBAQUABIIBAIAM BigIUlqWeslZ4d0/uJFf9f0FQIHUZ2yjfQzdBQMeLzve3SlBW3YApuJdNVzxTx7CdHpTw0OIZkm9 UMl7MohgqZ/hqO+W98ZyE8zpclTdkm6dpt0mKvmgX98pBN7Wm3VkmX+m7FrJh/cVYmBr/2mfLTAt LCwFXX0VuXZnHKgz5kJHn2FhK2xCmhKojEjf/Jc407K8kqJVWtWC84TbeYFfFOqXFXBPDJE9IS13 OYaEoAoNv2R9hxOYav4fGVWHA3g8vYr8D4AnuE+FtbyalbwEhIdErwzo/sRtPHz6I7bKAKjAyM8Z 05WN+WTbmZPRGs4N8tzKai7wLjQg+RJGzZwAAAAAAAA= --Apple-Mail-1--133146176--