hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14167) Use work directories provided by Tez instead of directly using YARN local dirs
Date Fri, 22 Jul 2016 17:57:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389926#comment-15389926
] 

Siddharth Seth commented on HIVE-14167:
---------------------------------------

This completely broke LLAP. LlapProxy.setDaemon happens in  serviceInit. It's checked in main
when starting a regular daemon - so work dirs ends up not being set (i.e. null).
It does not break the system tests because they don't use LlapDaemon.main() - and instead
instantiate LlapDaemon directly as they should.

Reverting and re-opening.

> Use work directories provided by Tez instead of directly using YARN local dirs
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-14167
>                 URL: https://issues.apache.org/jira/browse/HIVE-14167
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 2.1.0
>            Reporter: Siddharth Seth
>            Assignee: Wei Zheng
>             Fix For: 2.2.0, 2.1.1
>
>         Attachments: HIVE-14167.1.patch, HIVE-14167.2.patch, HIVE-14167.3.patch
>
>
> HIVE-13303 fixed things to use multiple directories instead of a single tmp directory.
However it's using yarn-local-dirs directly.
> I'm not sure how well using the yarn-local-dir will work on a secure cluster.
> Would be better to use Tez*Context.getWorkDirs. This provides an app specific directory
- writable by the user.
> cc [~sershe]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message