hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jianshi Huang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-11622) completebulkload/loadIncrementalHFiles cannot specify table with namespace
Date Thu, 31 Jul 2014 02:02:39 GMT
Jianshi Huang created HBASE-11622:

             Summary: completebulkload/loadIncrementalHFiles cannot specify table with namespace
                 Key: HBASE-11622
                 URL: https://issues.apache.org/jira/browse/HBASE-11622
             Project: HBase
          Issue Type: Bug
    Affects Versions: 0.98.0
            Reporter: Jianshi Huang

I'm using completebulkload to load 500GB of data to a table (presplitted). However, it reports
the following errors:

Looks like completebulkload didn't recognize the namespace part (namespace:table).

Caused by: java.net.URISyntaxException: Relative path in absolute URI: grapple:vertices,37.bottom
        at java.net.URI.checkPath(URI.java:1804)
        at java.net.URI.<init>(URI.java:752)
        at org.apache.hadoop.fs.Path.initialize(Path.java:203)

By looking at the source code of LoadIncrementalHFiles.java, it seems the temporary path created
for splitting will contain ':',

The error part should be this:
String uniqueName = getUniqueName(table.getName());
    HColumnDescriptor familyDesc = table.getTableDescriptor().getFamily(item.family);
    Path botOut = new Path(tmpDir, uniqueName + ".bottom");
    Path topOut = new Path(tmpDir, uniqueName + ".top");
    splitStoreFile(getConf(), hfilePath, familyDesc, splitKey,
        botOut, topOut);

uniqueName will be "namespce:table" so "new Path(...)" will fail.

A bug?

Comment from Matteo Bertozzi:

we don't need the name to be related to the table name.
We can replace the getUniqueName() using something like this

  String getUniqueName(TableName tableName) {
    String name = UUID.randomUUID().toString().replaceAll("-", "") +
                  "," + regionCount.incrementAndGet();
    return name;

This message was sent by Atlassian JIRA

View raw message