hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14801) Enhance the Spark-HBase connector catalog with json format
Date Wed, 09 Mar 2016 17:54:40 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187518#comment-15187518

Jonathan Hsieh commented on HBASE-14801:

>From Zhan in the code review.

The existing code already has around 40 such warnings.  I think they are false positive. 
For exmaple, one new warning as Class org.apache.hadoop.hbase.spark.HBaseRelation$$anonfun$14
defines non-transient non-serializable instance field config$1
hbaseContext is serializable, but config is not serializable as a member of HBaseRelation$$anonfun$14.
However, here config has been defined as @transient in HBaseContext.
  //create or get latest HBaseContext
  val hbaseContext:HBaseContext = if (useHBaseContext) {
  } else {
    val config = HBaseConfiguration.create()
    configResources.split(",").foreach( r => config.addResource(r))
    new HBaseContext(sqlContext.sparkContext, config)

> Enhance the Spark-HBase connector catalog with json format
> ----------------------------------------------------------
>                 Key: HBASE-14801
>                 URL: https://issues.apache.org/jira/browse/HBASE-14801
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Zhan Zhang
>            Assignee: Zhan Zhang
>         Attachments: HBASE-14801-1.patch, HBASE-14801-2.patch, HBASE-14801-3.patch, HBASE-14801-4.patch,
HBASE-14801-5.patch, HBASE-14801-6.patch, HBASE-14801-7.patch, HBASE-14801-8.patch

This message was sent by Atlassian JIRA

View raw message