hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sakin cali <sakinnnc...@gmail.com>
Subject Re: Problem doing bulk load programmatically
Date Thu, 24 May 2012 07:05:34 GMT
Something new...

When I start MiniDfsCluster and use its filesystem in my code,
bulk load finishes successfully..

dfs = new MiniDFSCluster(conf, 2, true, (String[]) null);
41.// set file system to the mini dfs just started up
42.FileSystem fs = dfs.getFileSystem();

I think I have a problem accessing running HDFS ..


On 24 May 2012 09:12, sakin cali <sakinnncali@gmail.com> wrote:

> Hi,
>
> I am trying generate an HFile and load it to hbase programmatically.
> (importtsv does not fit my requirements)
>
> I have modified TestLoadIncrementalHFiles class and try to load an example
> hfile.
>
> But I get errors at the last step
>
> --------------------------------------
> java.io.IOException: java.io.IOException: Failed rename of *
> file:/tmp/hbase/test/myfam/_tmp/mytable,1.top* to *
> file:/tmp/hbase-hbase/hbase/mytable/742248ed8cda9fe0dce2f345149fa8d5/myfam/8964877901933124837
> *
>  at
> org.apache.hadoop.hbase.regionserver.StoreFile.rename(StoreFile.java:512)
> ----------------------------------------
>
> Although such an error occured, renaming seems succesfully because when I
> checked their md5sum values, I saw that both have the same values...
>
> I could not figure out the problem,
> any ideas?
>
> I have attached test code and logs.
>
> I'am using cloudera's virtualbox vm image for testing environment
> ( 64 bit centos, version Cdh3u4 )
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message