hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lance Norskog <goks...@gmail.com>
Subject Re: Hive regex SerDe issue?
Date Thu, 14 Apr 2011 02:31:08 GMT
. Usually this is a positive-integer problem somewhere. If you use a
32-bit Java this would be a problem.

On Wed, Apr 13, 2011 at 3:16 PM, hadoopman <hadoopman@gmail.com> wrote:
> Is there an issue with using the regex SerDe with loading into Hive text
> files above 2 gigs in size?  I've been experiencing out of memory errors
> with a select group of logs when running a hive job.  I have been able to
> load the data if I use split to cut it in half or thirds.  No problem.
>
> Googling around and figured I'd ask while I'm digging into this.
>
> Thanks!
>



-- 
Lance Norskog
goksron@gmail.com

Mime
View raw message