Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of regestrer@gmail.com designates
 74.125.82.169 as permitted sender)
Message-ID: <54B7E070.10808@gmail.com>
Date: Thu, 15 Jan 2015 17:44:48 +0200
From: peterm_second <regestrer@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.3.0
MIME-Version: 1.0
To: "user@tez.apache.org" <user@tez.apache.org>,
 "user@hive.apache.org" <user@hive.apache.org>
Subject: Tez Hive Job failing during initialization
Content-Type: multipart/alternative;
 boundary="------------020705090209010106020702"

This is a multi-part message in MIME format.
--------------020705090209010106020702
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Hi Guys,
I am running a docker based hadoop cluster, with hive 0.14 and tez 0.6
I've had successfully managed to make my setup work before, I've 
increased the input data to my jobs and now I get this exception :

2015-01-15 14:56:32,872 ERROR [HistoryEventHandlingThread] yarn.YarnUncaughtExceptionHandler: Thread Thread[HistoryEventHandlingThread,5,main] threw an Exception.
java.util.ConcurrentModificationException
	at java.util.Hashtable$Enumerator.next(Hashtable.java:1367)
	at org.apache.hadoop.conf.Configuration.iterator(Configuration.java:2144)
	at org.apache.tez.dag.history.utils.DAGUtils.convertConfigurationToATSMap(DAGUtils.java:365)
	at org.apache.tez.dag.history.logging.impl.HistoryEventJsonConversion.convertAppLaunchedEvent(HistoryEventJsonConversion.java:139)
	at org.apache.tez.dag.history.logging.impl.HistoryEventJsonConversion.convertToJson(HistoryEventJsonConversion.java:64)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService.handleEvent(SimpleHistoryLoggingService.java:154)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService.access$300(SimpleHistoryLoggingService.java:38)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService$1.run(SimpleHistoryLoggingService.java:108)
	at java.lang.Thread.run(Thread.java:745)


Which frustrates me to no end, what could possibly be happening that 
would cause a ConcurentModificationException.

The sql I am running is

select  pdepartment.PdDepartment , incidents.DayOfWeek , category.Category , count(incidents.incidntNum) NumberOfIncidents
from  incidents
JOIN category ON ( category.key = incidents.Category_Id )
JOIN pdepartment ON ( pdepartment.key = incidents.PdDistrict_Id )
group  by  pdepartment.PdDepartment, incidents.DayOfWeek, category.Category with cube


As I said I am certain that my set up works, I've changed nothing and  I 
get only this one exception in the logs, and that's in the yarn log. The 
mr job logs are clean. The tez hadoop app isn't failing it just hangs.

Have you guys seen anything like that before? Any ideas what might the 
problem be ? I'd love any suggestion cause I am out of ideas.

Thanks,
Peter

--------------020705090209010106020702
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=utf-8">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Hi Guys,<br>
    I am running a docker based hadoop cluster, with hive 0.14 and tez
    0.6 <br>
    I've had successfully managed to make my setup work before, I've
    increased the input data to my jobs and now I get this exception : <br>
    <br>
    <meta http-equiv="content-type" content="text/html; charset=utf-8">
    <pre style="margin: 0px; border: 0px; color: rgb(34, 34, 34); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);">2015-01-15 14:56:32,872 ERROR [HistoryEventHandlingThread] yarn.YarnUncaughtExceptionHandler: Thread Thread[HistoryEventHandlingThread,5,main] threw an Exception.
java.util.ConcurrentModificationException
	at java.util.Hashtable$Enumerator.next(Hashtable.java:1367)
	at org.apache.hadoop.conf.Configuration.iterator(Configuration.java:2144)
	at org.apache.tez.dag.history.utils.DAGUtils.convertConfigurationToATSMap(DAGUtils.java:365)
	at org.apache.tez.dag.history.logging.impl.HistoryEventJsonConversion.convertAppLaunchedEvent(HistoryEventJsonConversion.java:139)
	at org.apache.tez.dag.history.logging.impl.HistoryEventJsonConversion.convertToJson(HistoryEventJsonConversion.java:64)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService.handleEvent(SimpleHistoryLoggingService.java:154)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService.access$300(SimpleHistoryLoggingService.java:38)
	at org.apache.tez.dag.history.logging.impl.SimpleHistoryLoggingService$1.run(SimpleHistoryLoggingService.java:108)
	at java.lang.Thread.run(Thread.java:745)</pre>
    <br>
    Which frustrates me to no end, what could possibly be happening that
    would cause a ConcurentModificationException. <br>
    <br>
    The sql I am running is <br>
    <meta http-equiv="content-type" content="text/html; charset=utf-8">
    <pre class="code-sql" style="margin: 0px; padding: 0px; max-height: 30em; overflow: auto; white-space: pre-wrap; word-wrap: normal; color: rgb(51, 51, 51); font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: 16px; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(245, 245, 245);"><span class="code-keyword" style="color: rgb(0, 0, 145);">select</span> pdepartment.PdDepartment , incidents.DayOfWeek , category.Category , count(incidents.incidntNum) NumberOfIncidents 
<span class="code-keyword" style="color: rgb(0, 0, 145);">from</span> incidents  
JOIN category ON ( category.key = incidents.Category_Id )  
JOIN pdepartment ON ( pdepartment.key = incidents.PdDistrict_Id ) 
<span class="code-keyword" style="color: rgb(0, 0, 145);">group</span> <span class="code-keyword" style="color: rgb(0, 0, 145);">by</span> pdepartment.PdDepartment, incidents.DayOfWeek, category.Category with cube</pre>
    <br>
    As I said I am certain that my set up works, I've changed nothing
    and  I get only this one exception in the logs, and that's in the
    yarn log. The mr job logs are clean. The tez hadoop app isn't
    failing it just hangs. <br>
    <br>
    Have you guys seen anything like that before? Any ideas what might
    the problem be ? I'd love any suggestion cause I am out of ideas. <br>
    <br>
    Thanks,<br>
    Peter<br>
  </body>
</html>

--------------020705090209010106020702--