hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gj <tomson8...@126.com>
Subject hive-1.2.1 kryo serialization same to be block.
Date Thu, 26 Nov 2015 07:00:55 GMT
throws many similar issue:
2015-11-26 14:41:50,467 Stage-6 map = 100%,  reduce = 92%, Cumulative CPU 236.92 sec
2015-11-26 14:41:57,899 Stage-6 map = 100%,  reduce = 96%, Cumulative CPU 242.86 sec
2015-11-26 14:42:05,394 Stage-6 map = 100%,  reduce = 100%, Cumulative CPU 242.86 sec
MapReduce Total cumulative CPU time: 4 minutes 2 seconds 860 msec
Ended Job = job_1448437287773_0615 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1448437287773_0615_m_000006 (and more) from job job_1448437287773_0615
Examining task ID: task_1448437287773_0615_m_000004 (and more) from job job_1448437287773_0615
Examining task ID: task_1448437287773_0615_r_000008 (and more) from job job_1448437287773_0615
Examining task ID: task_1448437287773_0615_r_000018 (and more) from job job_1448437287773_0615
Examining task ID: task_1448437287773_0615_r_000019 (and more) from job job_1448437287773_0615


Task with the most failures(4): 
-----
Task ID:
  task_1448437287773_0615_r_000005


URL:
  http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1448437287773_0615&tipid=task_1448437287773_0615_r_000005
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: Error in configuring object
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
        at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:409)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:106)
        ... 9 more
Caused by: java.lang.RuntimeException: org.apache.hive.com.esotericsoftware.kryo.KryoException:
Encountered unregistered class ID: 109
Serialization trace:
keyDesc (org.apache.hadoop.hive.ql.plan.ReduceWork)
        at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:423)
        at org.apache.hadoop.hive.ql.exec.Utilities.getReduceWork(Utilities.java:294)
        at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.configure(ExecReducer.java:117)
        ... 14 more
Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered unregistered
class ID: 109
Serialization trace:
keyDesc (org.apache.hadoop.hive.ql.plan.ReduceWork)
        at org.apache.hive.com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:119)
        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:656)
        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:99)
        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)
        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)
        at org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:1025)
        at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:933)
        at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:947)
        at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:403)
        ... 16 more




FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 
Stage-Stage-6: Map: 7  Reduce: 24   Cumulative CPU: 242.86 sec   HDFS Read: 489820186 HDFS
Write: 2208 FAIL
Total MapReduce CPU Time Spent: 4 minutes 2 seconds 860 msec
Mime
View raw message