Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA55018B4C for ; Thu, 22 Oct 2015 12:06:29 +0000 (UTC) Received: (qmail 30766 invoked by uid 500); 22 Oct 2015 12:06:29 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 30691 invoked by uid 500); 22 Oct 2015 12:06:29 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 30680 invoked by uid 99); 22 Oct 2015 12:06:29 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Oct 2015 12:06:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id E5668C0F8A for ; Thu, 22 Oct 2015 12:06:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.288 X-Spam-Level: ** X-Spam-Status: No, score=2.288 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.008, HTML_MESSAGE=3, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=basjes_nl.20150623.gappssmtp.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ybKdOrEtZxmJ for ; Thu, 22 Oct 2015 12:06:24 +0000 (UTC) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id E43262118F for ; Thu, 22 Oct 2015 12:06:23 +0000 (UTC) Received: by wikq8 with SMTP id q8so28532750wik.1 for ; Thu, 22 Oct 2015 05:06:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=basjes_nl.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to:content-type; bh=BgMFp7fCDsijdwrVRn/x9zfj1Uneo3fV/gYG/qEzhBg=; b=ZbC4MoQHbylLGirJjfE3Vsc9vX+Pl65xFRHBvT5bf3MO3TmPtrtg6lY1zsrznJ58JC GUthYmjs+5n+BfocXwD+7PfGyaZf4/5q0/sGVG55r/XUH0NRXWz2hCFKyl8LvffaZo9x C9B9Ziwv/MYOIFyMhVDapf9wb3c+8TrydqMIJ5KYGb3Ozjl/bq1vufsW7hLafSOoLqNH X671Zl3fHv3eXK2WzlswzOssG+QDCVHzANM9aXHKh23RnRCpLTeNBbFD9a911cSlSY8U 2WMGWr8RhIY/kpLxBQLNBlEvehYmKKdnfdfZNpPtucKgA4ov6H6VuvZmsvZCMGBCGeNj LYng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to :content-type; bh=BgMFp7fCDsijdwrVRn/x9zfj1Uneo3fV/gYG/qEzhBg=; b=EgponwxUQLts3HU3Zm+QBuz/TPcgHHjA1nt6AxVhzM+lvDOLFyVsV8Pj8o7EasmEQt 7R1w1zAWnNmUbE0of5kaoz0ViFBgzGlBFHZ/tTAX5GtPaNBIcSy3H4lR/FG9bh/YwllP 9PiAQ5W1SX3TTX1Dsmwcm8RdVhOJ63taYs+LR/RVJoZ2Vfkk401wauTKkOXetwbBs1iA 1ZYWd7afS8JC7iqsc4oyli9KFQtUj1dA8+tEE+nc5jozItJ4x1iiK7CxVIVp7+c7E5ZM kvD+O0m1risd95kXuVrHC6gD+w2QEpGufoXlkTxL6RTLo301xEBP6ucdseMNZASKAC4J lSWA== X-Gm-Message-State: ALoCoQlvbC+h+DcY6iwovuJQJ1+igfdkPzx1hiZpxaFBI1fmB8tntuekyuSM0p550VQE5bbphorc X-Received: by 10.194.239.167 with SMTP id vt7mr16361651wjc.110.1445515582410; Thu, 22 Oct 2015 05:06:22 -0700 (PDT) MIME-Version: 1.0 From: Niels Basjes Date: Thu, 22 Oct 2015 12:06:12 +0000 Message-ID: Subject: Running continuously on yarn with kerberos To: user@flink.apache.org Content-Type: multipart/alternative; boundary=089e013c60c0ceb0520522b0522c --089e013c60c0ceb0520522b0522c Content-Type: text/plain; charset=UTF-8 Hi, I want to write a long running (i.e. never stop it) streaming flink application on a kerberos secured Hadoop/Yarn cluster. My application needs to do things with files on HDFS and HBase tables on that cluster so having the correct kerberos tickets is very important. The stream is to be ingested from Kafka. One of the things with Kerberos is that the tickets expire after a predetermined time. My knowledge about kerberos is very limited so I hope you guys can help me. My question is actually quite simple: Is there an howto somewhere on how to correctly run a long running flink application with kerberos that includes a solution for the kerberos ticket timeout ? Thanks Niels Basjes --089e013c60c0ceb0520522b0522c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

Hi,

I want to write a long running (i.e. never stop it) streamin= g flink application on a kerberos secured Hadoop/Yarn cluster. My applicati= on needs to do things with files on HDFS and HBase tables on that cluster s= o having the correct kerberos tickets is very important. The stream is to b= e ingested from Kafka.

One of the things with Kerberos is that the tickets expire a= fter a predetermined time. My knowledge about kerberos is very limited so I= hope you guys can help me.

My question is actually quite simple: Is there an howto some= where on how to correctly run a long running flink application with kerbero= s that includes a solution for the kerberos ticket timeout=C2=A0 ?

Thanks

Niels Basjes

--089e013c60c0ceb0520522b0522c--