flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhenqiu Huang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-10729) Create a Hive a connector to access Hive data
Date Wed, 31 Oct 2018 02:49:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669528#comment-16669528
] 

Zhenqiu Huang commented on FLINK-10729:
---------------------------------------

Hi Xuefu, I am interested with this Task, Would you please assign it to me?

> Create a Hive a connector to access Hive data
> ---------------------------------------------
>
>                 Key: FLINK-10729
>                 URL: https://issues.apache.org/jira/browse/FLINK-10729
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table API &amp; SQL
>    Affects Versions: 1.6.2
>            Reporter: Xuefu Zhang
>            Assignee: Zhenqiu Huang
>            Priority: Major
>
> As part of Flink-Hive integration effort, it's important for Flink to access (read/write)
Hive data, which is the responsibility of Hive connector. While there is a HCatalog data connector
in the code base, it's not complete (i.e. missing all connector related classes such as validators,
etc.). Further, HCatalog interface has many limitations such as accessing a subset of Hive
data, supporting a subset of Hive data types, etc. In addition, it's not actively maintained.
In fact, it's now only a sub-project in Hive.
> Therefore, here we propose a complete connector set for Hive tables, not via HCatalog,
but via direct Hive interface. HCatalog connector will be deprecated.
> Please note that connector on Hive metadata is already covered in other JIRAs, as {{HiveExternalCatalog}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message