spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaochen Ouyang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-19935) SparkSQL unsupports to create a hive table which is mapped for HBase table
Date Sat, 08 Apr 2017 04:04:41 GMT

    [ https://issues.apache.org/jira/browse/SPARK-19935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961670#comment-15961670
] 

Xiaochen Ouyang edited comment on SPARK-19935 at 4/8/17 4:04 AM:
-----------------------------------------------------------------

[~wangchao2017] Not yet! I tried to work on this issue, but now only support to create table
and scan table.
Throwing an exeception when run insert command because Spark2.x have no HBaseFileFormat for
Writing HBase.
code as follow :
      @transient private lazy val outputFormat =
        jobConf.value.getOutputFormat.asInstanceOf[HiveOutputFormat[AnyRef, Writable]]


was (Author: ouyangxc.zte):
Not yet! I tried to work on this issue, but now only support to create table and scan table.
Throwing an exeception when run insert command because Spark2.x have no HBaseFileFormat for
Writing HBase.
code as follow :
      @transient private lazy val outputFormat =
        jobConf.value.getOutputFormat.asInstanceOf[HiveOutputFormat[AnyRef, Writable]]

> SparkSQL unsupports to create a hive table which is mapped for HBase table
> --------------------------------------------------------------------------
>
>                 Key: SPARK-19935
>                 URL: https://issues.apache.org/jira/browse/SPARK-19935
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>         Environment: spark2.0.2
>            Reporter: Xiaochen Ouyang
>
> SparkSQL unsupports the command as following:
>  CREATE TABLE spark_test(key int, value string)   
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'   
> WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val")   
> TBLPROPERTIES ("hbase.table.name" = "xyz");



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message