hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-13651) LlapBaseInputFormat: figure out where credentials come from
Date Tue, 10 May 2016 22:56:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279151#comment-15279151
] 

Sergey Shelukhin edited comment on HIVE-13651 at 5/10/16 10:55 PM:
-------------------------------------------------------------------

Oh, so this JIRA already exists. The serialized token will be a part of getSplits UDF output.
Does it make sense after that?

Presumably we can also add HDFS tokens or whatever there, if needed. What HS2 already gives
to AM, although I am not super familiar with that path.


was (Author: sershe):
Oh, so this JIRA already exists. The serialized token will be a part of getSplits UDF output.
Does it make sense after that?

> LlapBaseInputFormat: figure out where credentials come from
> -----------------------------------------------------------
>
>                 Key: HIVE-13651
>                 URL: https://issues.apache.org/jira/browse/HIVE-13651
>             Project: Hive
>          Issue Type: Sub-task
>          Components: llap
>            Reporter: Jason Dere
>
> todo in LlapBaseInputFormat.constructSubmitWorkRequestProto()
> {code}
>     // TODO Figure out where credentials will come from. Normally Hive sets up
>     // URLs on the tez dag, for which Tez acquires credentials.
>     //    taskCredentials.addAll(getContext().getCredentials());
>     //    Preconditions.checkState(currentQueryIdentifierProto.getDagIdentifier() ==
>     //        taskSpec.getTaskAttemptID().getTaskID().getVertexID().getDAGId().getId());
>     //    ByteBuffer credentialsBinary = credentialMap.get(currentQueryIdentifierProto);
>     //    if (credentialsBinary == null) {
>     //      credentialsBinary = serializeCredentials(getContext().getCredentials());
>     //      credentialMap.putIfAbsent(currentQueryIdentifierProto, credentialsBinary.duplicate());
>     //    } else {
>     //      credentialsBinary = credentialsBinary.duplicate();
>     //    }
>     //    builder.setCredentialsBinary(ByteString.copyFrom(credentialsBinary));
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message