hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: mapreduce.LoadIncrementalHFiles hangs..
Date Fri, 20 Jun 2014 02:25:57 GMT
Was cluster-04 always showing up in the log ?

Have you checked region server log on cluster-04 ?

Cheers


On Thu, Jun 19, 2014 at 6:09 PM, Chen Wang <chen.apache.solr@gmail.com>
wrote:

> Last piece of the puzzle!
>
> My Mapreduce succeeded in generating hdfs file, However, bulk load with the
> following code:
>
> LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf);
>
>  loader.doBulkLoad(newExecutionOutput, candidateSendTable);
>
> Just hangs there without any output. I tried to run
>
> hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
> <hdfs://storefileoutput> <tablename>
>
> It seems to get into some kind of infinite loop..
>
> *2014-06-19 18:06:29,990 DEBUG [LoadIncrementalHFiles-1]
> client.HConnectionManager$HConnectionImplementation: Removed
> cluster-04:60020 as a location of
> [tablenae],1403133308612.060ff9282b3b653c59c1e6be82d2521a. for
> tableName=[table] from cache*
>
> *2014-06-19 18:06:30,004 DEBUG [LoadIncrementalHFiles-1]
> mapreduce.LoadIncrementalHFiles: Going to connect to server
> region=[tablename],,1403133308612.060ff9282b3b653c59c1e6be82d2521a.,
> hostname=cluster-04,60020,1403211430209, seqNum=1 for row  with hfile group
> [{[B@3b5d5e0d,hdfs://mypath}]*
>
> *2014-06-19 18:06:45,839 DEBUG [LruStats #0] hfile.LruBlockCache:
> Total=3.17 MB, free=383.53 MB, max=386.70 MB, blocks=0, accesses=0, hits=0,
> hitRatio=0, cachingAccesses=0, cachingHits=0,
> cachingHitsRatio=0,evictions=0, evicted=0, evictedPerRun=NaN*
>
>
> *Any guidence on how I can debug this?*
>
> *Thanks much!*
>
> *Chen*
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message