hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerry He (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-15223) Make pubic convertScanToString for Spark
Date Fri, 05 Feb 2016 22:32:39 GMT
Jerry He created HBASE-15223:

             Summary: Make pubic convertScanToString for Spark
                 Key: HBASE-15223
                 URL: https://issues.apache.org/jira/browse/HBASE-15223
             Project: HBase
          Issue Type: Improvement
            Reporter: Jerry He

One way to access HBase from Spark is to use newAPIHadoopRDD, which can take a TableInputFormat
as class name.  But we are not able to set a Scan object in there, for example to set a HBase

In MR,  the public API TableMapReduceUtil.initTableMapperJob() or equivalent is used which
can take a Scan object.  But this call is not used in Spark conveniently. 

We need to make the TableMapReduceUtil.convertScanToString() public.
So that a Scan object can be created, populated and then convert to the property and used
by Spark.  They are now package private.  

This message was sent by Atlassian JIRA

View raw message