lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sudarsan, Sithu D." <Sithu.Sudar...@fda.hhs.gov>
Subject RE: Parsing large xml files
Date Thu, 21 May 2009 15:12:35 GMT
Thanks, I'll try that and get back to you 


Sincerely,
Sithu D Sudarsan

-----Original Message-----
From: Michael Barbarelli [mailto:mbarbarelli@gmail.com] 
Sent: Thursday, May 21, 2009 10:52 AM
To: java-user@lucene.apache.org
Subject: Re: Parsing large xml files

Why not use an XML pull parser?  I recommend against using an in-memory
parser.

On Thu, May 21, 2009 at 3:42 PM, Sudarsan, Sithu D. <
Sithu.Sudarsan@fda.hhs.gov> wrote:

>
> Hi,
>
> While trying to parse xml documents of about 50MB size, we run into
> OutOfMemoryError due to java heap space. Increasing JVM to use close
2GB
> (that is the max), does not help. Is there any API that could be used
to
> handle such large single xml files?
>
> If Lucene is not the right place, please let me know alternate places
to
> look for,
>
> Thanks in advance,
> Sithu D Sudarsan
> sithu.sudarsan@fda.hhs.gov
> sdsudarsan@ualr.edu
>
>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message