Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 401B5200B91 for ; Thu, 29 Sep 2016 19:48:05 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3EC7F160AE3; Thu, 29 Sep 2016 17:48:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 5B123160AC1 for ; Thu, 29 Sep 2016 19:48:04 +0200 (CEST) Received: (qmail 79189 invoked by uid 500); 29 Sep 2016 17:48:03 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 79180 invoked by uid 99); 29 Sep 2016 17:48:03 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 Sep 2016 17:48:03 +0000 Received: from mail-it0-f49.google.com (mail-it0-f49.google.com [209.85.214.49]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 21B0A1A015B for ; Thu, 29 Sep 2016 17:48:03 +0000 (UTC) Received: by mail-it0-f49.google.com with SMTP id u134so123920364itb.1 for ; Thu, 29 Sep 2016 10:48:03 -0700 (PDT) X-Gm-Message-State: AA6/9Rn0/HhjOEMZQTBe6egtaJNFNXkZt+PGM1Hu9U76ZHwpIop2cfOYBRQ5UGNuwOWwLiZ87BdJzFPI2bnR4Q== X-Received: by 10.36.98.72 with SMTP id d69mr9762499itc.118.1475171282524; Thu, 29 Sep 2016 10:48:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.13.140 with HTTP; Thu, 29 Sep 2016 10:48:02 -0700 (PDT) In-Reply-To: References: From: Stephan Ewen Date: Thu, 29 Sep 2016 19:48:02 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Flink-HBase connectivity through Kerberos keytab | Simple get/put sample implementation To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a113f6ade47269a053da914f0 archived-at: Thu, 29 Sep 2016 17:48:05 -0000 --001a113f6ade47269a053da914f0 Content-Type: text/plain; charset=UTF-8 Hi! In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's mechanism: https://ci.apache.org/projects/flink/flink-docs- master/setup/config.html#kerberos In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context, from which HBase can probably pick it up. This is quite new (docs are not yet updated), I'll let others chime in to add some more details. @Max / @Vijay do you have any details? Stephan On Thu, Sep 29, 2016 at 7:47 PM, Stephan Ewen wrote: > Hi! > > In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's > mechanism: https://ci.apache.org/projects/flink/flink-docs- > master/setup/config.html#kerberos > > In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context, > from which HBase can probably pick it up. This is quite new, I'll let > others chime in to add some more details. > > @Max / @ > > On Thu, Sep 29, 2016 at 7:20 PM, Anchit Jatana < > development.anchit@gmail.com> wrote: > >> Hi Fabian, >> >> Right, I hope the committers take into account the kerberised access as >> well. Thanks for the update! >> >> Regards, >> Anchit >> >> On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske wrote: >> >>> Hi Anchit, >>> >>> Flink does not yet have a streaming sink connector for HBase. Some >>> members of the community are working on this though [1]. >>> I think we resolved a similar issue for the Kafka connector recently >>> [2]. >>> Maybe the related commits contain some relevant code for your problem. >>> >>> Best, Fabian >>> >>> [1] https://github.com/apache/flink/pull/2332 >>> [2] https://issues.apache.org/jira/browse/FLINK-3239 >>> >>> 2016-09-29 9:12 GMT+02:00 Anchit Jatana : >>> >>>> Hi All, >>>> >>>> I'm trying to link my flink application with HBase for simple >>>> read/write operations. I need to implement Flink to HBase the connectivity >>>> through Kerberos using the keytab. >>>> >>>> Can somebody share(or link me to some resource) a sample >>>> code/implementation on how to achieve Flink to HBase connectivity through >>>> Kerberos using keytab for simple read/write (get/put) operation. >>>> >>>> Thank you! >>>> >>>> Regards, >>>> Anchit >>>> >>> >>> >> > --001a113f6ade47269a053da914f0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi!

In Flink prior t= o 1.2, you can use Kerberos with HBase via Hadoop's mechanism:=C2=A0https://ci.apache.org/projects/flink= /flink-docs-master/setup/config.html#kerberos

In Flink 1.= 2-SNAPSHOT, keytabs are installed in the Java security context, from which = HBase can probably pick it up. This is quite new (docs are not yet updated)= , I'll let others chime in to add some more details.

@Max / @Vijay = do you have any details?

Stephan
<= br>

On= Thu, Sep 29, 2016 at 7:47 PM, Stephan Ewen <sewen@apache.org> wrote:
Hi!

<= /div>
In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop= 's mechanism:=C2=A0https://ci.apac= he.org/projects/flink/flink-docs-master/setup/config.html#ke= rberos

In Flink 1.2-SNAPSHOT, keytabs are inst= alled in the Java security context, from which HBase can probably pick it u= p. This is quite new, I'll let others chime in to add some more details= .

@Max / @

On Th= u, Sep 29, 2016 at 7:20 PM, Anchit Jatana <development.anchit@g= mail.com> wrote:
Hi Fabian,

Right, I hope the committers t= ake into account the kerberised access as well. Thanks for the update!
=
Regards,
Anchit

On Thu, Sep 29, 2016 at 6:15 A= M, Fabian Hueske <fhueske@gmail.com> wrote:
Hi Anchit,

Flink = does not yet have a streaming sink connector for HBase. Some members of the= community are working on this though [1].
I think we resolve= d a similar issue for the Kafka connector recently [2].
Maybe the relat= ed commits contain some relevant code for your problem.

B= est, Fabian

2016-09-29 9:12 GMT+02:00 Anchit Jatana <development.a= nchit@gmail.com>:
Hi All,

I'm trying to link my flink app= lication with HBase for simple read/write operations. I need to implement F= link to HBase the connectivity through Kerberos using the keytab.

Can somebody share(or link me to some resource) a sample co= de/implementation on how to achieve Flink to HBase connectivity through Ker= beros using keytab for simple read/write (get/put) operation.
Thank you!

Regards,
Anchit




--001a113f6ade47269a053da914f0--