hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nimra Choudhary <>
Subject RE: dynamic partition import
Date Tue, 29 May 2012 09:41:58 GMT
All my data nodes are up and running with none blacklisted.


From: Nitin Pawar []
Sent: Tuesday, May 29, 2012 3:07 PM
Subject: Re: dynamic partition import

can you check atleast one datanode is running and is not part of blacklisted nodes

On Tue, May 29, 2012 at 3:01 PM, Nimra Choudhary <<>>

We are using Dynamic partitioning and facing the similar problem. Below is the jobtracker
error log. We have a hadoop cluster of 6 nodes, 1.16 TB capacity with over 700GB still free.

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.ipc.RemoteException: File /tmp/hive-nimrac/hive_2012-05-29_10-32-06_332_4238693577104368640/_tmp.-ext-10000/createddttm=2011-04-24/_tmp.000001_2
could only be replicated to 0 nodes, instead of 1
               at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(
               at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(
               at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source)
               at sun.reflect.DelegatingMethodAccessorImpl.invoke(
               at java.lang.reflect.Method.invoke(
               at org.apache.hadoop.ipc.RPC$
               at org.apache.hadoop.ipc.Server$Handler$
               at org.apache.hadoop.ipc.Server$Handler$
               at Method)
               at org.apache.hadoop.ipc.Server$

               at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(
               at org.apache.hadoop.hive.ql.exec.Operator.process(
               at org.apache.hadoop.hive.ql.exec.Operator.forward(
               at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(
               at org.apache.hadoop.hive.ql.exec.Operator.process(
               at org.apache.hadoop.hive.ql.exec.Operator.forward(
               at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(
               at org.apache.hadoop.hive.ql.exec.Operator.process(
               at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(

Is there any workaround or fix for this?


Nitin Pawar

View raw message