jackrabbit-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcin Nowak" <marcin.j.no...@comarch.com>
Subject RE: JackRabbit import performance
Date Fri, 20 Oct 2006 06:11:23 GMT
Hi,

I've attached files I've been using for tests /oneMB.xml passed tests but
the memory usage was extremely high, sixMB.xml causes outOfMemory error/

BR,
Marcin Nowak


-----Original Message-----
From: Alexandru Popescu [mailto:the.mindstorm.mailinglist@gmail.com] 
Sent: Tuesday, October 17, 2006 9:32 PM
To: users@jackrabbit.apache.org
Subject: Re: JackRabbit import performance

On 10/17/06, Marcin Nowak <marcin.j.nowak@comarch.com> wrote:
> I did the following:
>
> Workspace currentWorkspace = currentSession.getWorkspace();
> File file = new File(p_path);
> FileInputStream fis = new FileInputStream(file);
> Node temp; <-- meaning reference to a node in repository where I'm
importing
> currentWorkspace.importXML(temp.getPath(), fis,
> importUUIDBehavior.IMPORT_UUID_CREATE_NEW);
>
> or
>
> File file = new File(p_path);
> FileInputStream fis = new FileInputStream(file);
> Node temp; <-- meaning reference to a node in repository where I'm
importing
> currentSession.importXML(temp.getPath(), fis,
> ImportUUIDBehavior.IMPORT_UUID_CREATE_NEW);
>
> Repository on which I am testing performance contains one workspace, I am
> logging into it using SimpleCredentials, XML which I've imported was
1,17MB
> large, and import took ca. 3 minutes 30 seconds and ca. 550MB of server
> system memory, when importing 6MB XML repository server crashes and I get
> OutOfMemory error. VM config is -Xms256m -Xmx512m
>
> Regards,
> Marcin Nowak
>

If your XML file doesn't contain sensitive data, I think it would be
nice to attach it here. I will try to profile it and see where the
problem may be.

./alex
--
.w( the_mindstorm )p.

> -----Original Message-----
> From: Alexandru Popescu [mailto:the.mindstorm.mailinglist@gmail.com]
> Sent: Tuesday, October 17, 2006 1:44 PM
> To: users@jackrabbit.apache.org
> Subject: Re: JackRabbit import performance
>
> On 10/17/06, Marcin Nowak <marcin.j.nowak@comarch.com> wrote:
> > Hi,
> >
> > As you said before I've tested importing using workspace and results are
> the
> > same. Has anyone also tested jackrabbit performance in importing large
XML
> > files/greater than 5MB/? What are importXML() limitations and what are
> they
> > depend from?
> >
>
> Marcin can you profile the import and let us know the results? Or at
> least provide a quick testcase so that I can profile it myself.
>
> ./alex
> --
> .w( the_mindstorm )p.
>
> > Regards,
> > Marcin Nowak
> >
> > -----Original Message-----
> > From: Jukka Zitting [mailto:jukka.zitting@gmail.com]
> > Sent: Monday, October 16, 2006 5:29 PM
> > To: users@jackrabbit.apache.org
> > Subject: Re: JackRabbit import performance
> >
> > Hi,
> >
> > On 10/16/06, Pavel Jbanov <pavel.jbanov@gmail.com> wrote:
> > > A little OT, but anyways... Does export/importXML supports binary
> content?
> >
> > Yes. You need to give a false skipBinary flag to the export methods to
> > have binary content included using Base64 encoding. See the JCR
> > javadocs for the details.
> >
> > BR,
> >
> > Jukka Zitting
> >
> >
> > --
> > Empowering business
> > http://webinars.comarch.com
> >
>
>
> --
> Empowering business
> http://webinars.comarch.com
>


--
Empowering business
http://webinars.comarch.com

Mime
View raw message