flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Timo Walther <twal...@apache.org>
Subject Re: Regarding external metastore like HIVE
Date Tue, 03 Jul 2018 09:31:14 GMT
Hi,

you can follow the progress here: 
https://issues.apache.org/jira/browse/FLINK-9171

Regards,
Timo


Am 03.07.18 um 10:32 schrieb Fabian Hueske:
> Hi,
>
> The docs explain that the ExternalCatalog interface *can* be used to 
> implement a catalog for HCatalog or Metastore.
> However, there is no such implementation in Flink yet. You would need 
> to implement such as catalog connector yourself.
>
> I think there would be quite a few people interested in such a connector.
>
> Best, Fabian
>
> 2018-07-03 10:24 GMT+02:00 Shivam Sharma <28shivamsharma@gmail.com 
> <mailto:28shivamsharma@gmail.com>>:
>
>     Hi,
>
>     Please find the documentation link here:
>     https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/table/common.html#register-an-external-catalog
>     <https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/table/common.html#register-an-external-catalog>.
>
>         Currently, Flink provides an|InMemoryExternalCatalog|for demo
>         and testing purposes. However, the|ExternalCatalog|interface
>         can also be used to connect catalogs like *HCatalog or
>         Metastore* to the Table API.
>
>
>     Thanks
>
>
>     On Tue, Jul 3, 2018 at 1:41 PM Chuanlei Ni <nichuanlei@gmail.com
>     <mailto:nichuanlei@gmail.com>> wrote:
>
>         @ashwin
>
>         I cannot find the documention about `metastore`
>
>         Could you give the reference?
>
>         Ashwin Sinha <ashwin.sinha@go-mmt.com
>         <mailto:ashwin.sinha@go-mmt.com>> 于2018年7月3日周二
>         下午4:08写道:
>
>             By metastore we mean catalog where table information is
>             stored.
>
>             On Tue 3 Jul, 2018, 13:23 Chesnay Schepler,
>             <chesnay@apache.org <mailto:chesnay@apache.org>> wrote:
>
>                 What do you mean with "Metastore"? Are you referring
>                 to state backends
>                 <https://ci.apache.org/projects/flink/flink-docs-master/ops/state/state_backends.html>?
>
>                 On 02.07.2018 18:41, Shivam Sharma wrote:
>>                 Hi,
>>
>>                 I have read Flink documentation that Flink supports
>>                 Metastore which is currently InMemory. Is Flink
>>                 community thinking to implement external Metastore
>>                 like Hive?
>>
>>                 Thanks
>>
>>                 -- 
>>                 Shivam Sharma
>>                 Data Engineer @ Goibibo
>>                 Indian Institute Of Information Technology, Design
>>                 and Manufacturing Jabalpur
>>                 Mobile No- (+91) 8882114744
>>                 Email:- 28shivamsharma@gmail.com
>>                 <mailto:28shivamsharma@gmail.com>
>>                 LinkedIn:-_https://www.linkedin.com/in/28shivamsharma
>>                 <https://www.linkedin.com/in/28shivamsharma>_
>
>
>
>             ::DISCLAIMER::
>
>             ----------------------------------------------------------------------------------------------------------------------------------------------------
>
>
>             This message is intended only for the use of the addressee
>             and may contain information that is privileged,
>             confidential and exempt from disclosure under applicable
>             law. If the reader of this message is not the intended
>             recipient, or the employee or agent responsible for
>             delivering the message to the intended recipient, you are
>             hereby notified that any dissemination, distribution or
>             copying of this communication is strictly prohibited. If
>             you have received this e-mail in error, please notify us
>             immediately by return e-mail and delete this e-mail and
>             all attachments from your system.
>
>
>
>     -- 
>     Shivam Sharma
>     Data Engineer @ Goibibo
>     Indian Institute Of Information Technology, Design and
>     Manufacturing Jabalpur
>     Mobile No- (+91) 8882114744
>     Email:- 28shivamsharma@gmail.com <mailto:28shivamsharma@gmail.com>
>     LinkedIn:-_https://www.linkedin.com/in/28shivamsharma
>     <https://www.linkedin.com/in/28shivamsharma>_
>
>


Mime
View raw message