jackrabbit-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ian Boston <...@tfd.co.uk>
Subject Re: Scalability issues while storing large number of small properties
Date Wed, 27 May 2009 12:11:44 GMT
Might be worth giving it more memory ? both perm space and heap, its a  
bit hard to see how much you have given it so far, but under load or  
with a large index space (thats number of terms not number of items) I  
would not be surprised to give the JVM 1G. (YMMV)

How much memory have you given it ?
Ian


On 27 May 2009, at 12:27, aasoj j wrote:

> Hi Ian,
>
> In case it helps, this is what I have observed:
>
> Heap
> PSYoungGen      total 61504K, used 16471K [0xb0d70000, 0xb6420000,  
> 0xb7f30000)
>  eden space 39488K, 40% used [0xb0d70000,0xb1ce7b70,0xb3400000)
>  from space 22016K, 2% used [0xb4ea0000,0xb4f3e398,0xb6420000)
>  to   space 24640K, 0% used [0xb3400000,0xb3400000,0xb4c10000)
> PSOldGen        total 315840K, used 270946K [0x77f30000, 0x8b3a0000,
> 0xb0d70000)
>  object space 315840K, 85% used [0x77f30000,0x887c88a8,0x8b3a0000)
> PSPermGen       total 41088K, used 23034K [0x73f30000, 0x76750000,  
> 0x77f30000)
>  object space 41088K, 56% used [0x73f30000,0x755aebd0,0x76750000)
>
> java.lang.OutOfMemoryError: Java heap space
> Dumping heap to /home/y/logs/
> /home/y/logs/yjava_tomcat ...
> Unable to create /home/y/logs/
> /home/y/logs/yjava_tomcat: No such file or directory
> Exception in thread "RMI TCP Connection(idle)" Exception in thread
> "RMI TCP Connection(idle)"
> Exception in thread "Thread-1" Exception in thread "RMI TCP
> Connection(idle)" Exception in thread
> "RMI TCP Connection(idle)" Exception in thread "http-0.0.0.0-4080- 
> Acceptor-0"
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)" Exception in thread
> "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
>        at java.lang.StringCoding.encode(StringCoding.java:266)
>        at java.lang.String.getBytes(String.java:947)
>        at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
>        at  
> java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:228)
>        at java.io.File.exists(File.java:733)
>        at  
> org 
> .apache 
> .log4j.helpers.FileWatchdog.checkAndConfigure(FileWatchdog.java:76)
>        at  
> org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:107)
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)" Exception in thread
> "RMI TCP Connection(idle)"
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
> Exception in thread "RMI TCP Connection(idle)"
> java.lang.OutOfMemoryError: Java heap space
>
> Regards
> aasoj
>
> On Wed, May 27, 2009 at 12:47 PM, Ian Boston <ieb@tfd.co.uk> wrote:
>
>> Hi,
>> Out of interest, what was the nature of the crash ?
>> Did the JVM just freeze or was there a traceback?
>> Ian
>>
>> On 27 May 2009, at 02:40, aasoj j wrote:
>>
>> Hi,
>>>
>>> I am a new jackrabbit user. We are using this repository for  
>>> storing our
>>> application's data. In doing so we are facing scalability issues.
>>>
>>> Our application has a huge number of properties, around 1 million.  
>>> These
>>> properties are distributed in versionable jackrabbit nodes, each  
>>> node
>>> having
>>> around 50 properties and 15 children nodes. Each property has a  
>>> unique 50
>>> character long value. We use MySql for persistence.
>>>
>>> While creating the tree our application crashed. The indexes grew  
>>> to more
>>> that 4.5 GB. Later when we tried to remove the root node, the  
>>> indexes grew
>>> to 15 GB and the application crashed again. As we plan to use search
>>> functionality, we cannot disable indexes.
>>>
>>> The actual data is around 100 MB. As jackrabbit is a content  
>>> store, I am
>>> sure it can support this data size. Please provide some pointers
>>> suggestion
>>> to fix the problem.
>>>
>>> Regards
>>> aasoj
>>>
>>
>>


Mime
View raw message