hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From java8964 <java8...@hotmail.com>
Subject RE: Joins Failing
Date Mon, 24 Mar 2014 21:00:50 GMT
It looks like his job failed in OOM in mapper tasks:
Job failed as tasks failed. failedMaps:1 failedReduces:0
So what he need is to increase the mapper heap size request.
Yong

Date: Mon, 24 Mar 2014 16:16:50 -0400
Subject: Re: Joins Failing
From: divakarreddy.a@gmail.com
To: user@hive.apache.org
CC: jason.herbaugh@bateswhite.com

I hope, this property will fix your issue.

set mapred.reduce.child.java.opts=-Xmx4096m;






On Mon, Mar 24, 2014 at 3:59 PM, Clay McDonald <stuart.mcdonald@bateswhite.com> wrote:

I believe I found my issue.



2014-03-24 15:49:38,775 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child
: java.lang.OutOfMemoryError: Java heap space





Clay







From: Clay McDonald [mailto:stuart.mcdonald@bateswhite.com]

Sent: Monday, March 24, 2014 2:07 PM

To: 'user@hive.apache.org'

Subject: Joins Failing



My join query is failing. Any suggestions on how I should troubleshoot this?



92651139753_0036_1_conf.xml to hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmp

2014-03-24 13:48:58,244 INFO [Thread-65] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copied to done location: hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmp

2014-03-24 13:48:58,248 INFO [Thread-65] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036.summary_tmp
to hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036.summary

2014-03-24 13:48:58,249 INFO [Thread-65] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmp
to hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml


2014-03-24 13:48:58,251 INFO [Thread-65] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036-1395683232406-root-SELECT+COUNT%28A.UPC_ID%29+AS+CNT%0D%0AFR...B.UPC_ID%28Stage-1395683335043-0-0-FAILED-default.jhist_tmp
to hdfs://dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036-1395683232406-root-SELECT+COUNT%28A.UPC_ID%29+AS+CNT%0D%0AFR...B.UPC_ID%28Stage-1395683335043-0-0-FAILED-default.jhist


2014-03-24 13:48:58,251 INFO [Thread-65] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopped JobHistoryEventHandler. super.stop()

2014-03-24 13:48:58,252 INFO [Thread-65] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator:
Setting job diagnostics to Task failed task_1392651139753_0036_m_000011

Job failed as tasks failed. failedMaps:1 failedReduces:0





Thanks Clay


 		 	   		  
Mime
View raw message