jackrabbit-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aasoj j <aas....@gmail.com>
Subject Re: Scalability issues while storing large number of small properties
Date Wed, 27 May 2009 11:27:09 GMT
Hi Ian,

In case it helps, this is what I have observed:

Heap
 PSYoungGen      total 61504K, used 16471K [0xb0d70000, 0xb6420000, 0xb7f30000)
  eden space 39488K, 40% used [0xb0d70000,0xb1ce7b70,0xb3400000)
  from space 22016K, 2% used [0xb4ea0000,0xb4f3e398,0xb6420000)
  to   space 24640K, 0% used [0xb3400000,0xb3400000,0xb4c10000)
 PSOldGen        total 315840K, used 270946K [0x77f30000, 0x8b3a0000,
0xb0d70000)
  object space 315840K, 85% used [0x77f30000,0x887c88a8,0x8b3a0000)
 PSPermGen       total 41088K, used 23034K [0x73f30000, 0x76750000, 0x77f30000)
  object space 41088K, 56% used [0x73f30000,0x755aebd0,0x76750000)

java.lang.OutOfMemoryError: Java heap space
Dumping heap to /home/y/logs/
/home/y/logs/yjava_tomcat ...
Unable to create /home/y/logs/
/home/y/logs/yjava_tomcat: No such file or directory
Exception in thread "RMI TCP Connection(idle)" Exception in thread
"RMI TCP Connection(idle)"
Exception in thread "Thread-1" Exception in thread "RMI TCP
Connection(idle)" Exception in thread
"RMI TCP Connection(idle)" Exception in thread "http-0.0.0.0-4080-Acceptor-0"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)" Exception in thread
"RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
        at java.lang.StringCoding.encode(StringCoding.java:266)
        at java.lang.String.getBytes(String.java:947)
        at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
        at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:228)
        at java.io.File.exists(File.java:733)
        at org.apache.log4j.helpers.FileWatchdog.checkAndConfigure(FileWatchdog.java:76)
        at org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:107)
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)" Exception in thread
"RMI TCP Connection(idle)"
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space
Exception in thread "RMI TCP Connection(idle)"
java.lang.OutOfMemoryError: Java heap space

Regards
aasoj

On Wed, May 27, 2009 at 12:47 PM, Ian Boston <ieb@tfd.co.uk> wrote:

> Hi,
> Out of interest, what was the nature of the crash ?
> Did the JVM just freeze or was there a traceback?
> Ian
>
> On 27 May 2009, at 02:40, aasoj j wrote:
>
>  Hi,
>>
>> I am a new jackrabbit user. We are using this repository for storing our
>> application's data. In doing so we are facing scalability issues.
>>
>> Our application has a huge number of properties, around 1 million. These
>> properties are distributed in versionable jackrabbit nodes, each node
>> having
>> around 50 properties and 15 children nodes. Each property has a unique 50
>> character long value. We use MySql for persistence.
>>
>> While creating the tree our application crashed. The indexes grew to more
>> that 4.5 GB. Later when we tried to remove the root node, the indexes grew
>> to 15 GB and the application crashed again. As we plan to use search
>> functionality, we cannot disable indexes.
>>
>> The actual data is around 100 MB. As jackrabbit is a content store, I am
>> sure it can support this data size. Please provide some pointers
>> suggestion
>> to fix the problem.
>>
>> Regards
>> aasoj
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message