hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15570) renewable delegation tokens for long-lived spark applications
Date Tue, 13 Sep 2016 15:01:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15487438#comment-15487438

Sean Busbey commented on HBASE-15570:

Maybe superceded by SPARK-14743?

> renewable delegation tokens for long-lived spark applications
> -------------------------------------------------------------
>                 Key: HBASE-15570
>                 URL: https://issues.apache.org/jira/browse/HBASE-15570
>             Project: HBase
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
> Right now our spark integration works on secure clusters by getting delegation tokens
and sending them to the executors. Unfortunately, applications that need to run for longer
than the delegation token lifetime (by default 7 days) will fail.
> In particular, this is an issue for Spark Streaming applications. Since they expect to
run indefinitely, we should have a means for renewing the delegation tokens.

This message was sent by Atlassian JIRA

View raw message