hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chen Wang <chen.apache.s...@gmail.com>
Subject mapreduce.LoadIncrementalHFiles hangs..
Date Fri, 20 Jun 2014 01:09:37 GMT
Last piece of the puzzle!

My Mapreduce succeeded in generating hdfs file, However, bulk load with the
following code:

LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf);

 loader.doBulkLoad(newExecutionOutput, candidateSendTable);

Just hangs there without any output. I tried to run

hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
<hdfs://storefileoutput> <tablename>

It seems to get into some kind of infinite loop..

*2014-06-19 18:06:29,990 DEBUG [LoadIncrementalHFiles-1]
client.HConnectionManager$HConnectionImplementation: Removed
cluster-04:60020 as a location of
[tablenae],1403133308612.060ff9282b3b653c59c1e6be82d2521a. for
tableName=[table] from cache*

*2014-06-19 18:06:30,004 DEBUG [LoadIncrementalHFiles-1]
mapreduce.LoadIncrementalHFiles: Going to connect to server
hostname=cluster-04,60020,1403211430209, seqNum=1 for row  with hfile group

*2014-06-19 18:06:45,839 DEBUG [LruStats #0] hfile.LruBlockCache:
Total=3.17 MB, free=383.53 MB, max=386.70 MB, blocks=0, accesses=0, hits=0,
hitRatio=0, cachingAccesses=0, cachingHits=0,
cachingHitsRatio=0,evictions=0, evicted=0, evictedPerRun=NaN*

*Any guidence on how I can debug this?*

*Thanks much!*


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message