hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3431) Resources on non-local file system should be downloaded to temporary directory sometimes
Date Mon, 31 Dec 2012 16:08:14 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13541398#comment-13541398
] 

Phabricator commented on HIVE-3431:
-----------------------------------

ashutoshc has commented on the revision "HIVE-3431 [jira] Resources on non-local file system
should be downloaded to temporary directory sometimes".

  I think it would be desirable to act consistently, instead of behaving differently depending
on configurations which user need to unnecessarily know and understand to derive correct behavior
out of system. With the patch as it is, user need to understand that if we he is running hive
in a server mode, than a particular config key mean differently and than he has to set it
to magic word temporary or some such to get correct correct behavior out of it. All of this
in my opinion is unnecessary for user to understand without any additional gain.

REVISION DETAIL
  https://reviews.facebook.net/D5199

BRANCH
  DPAL-1872

To: JIRA, ashutoshc, navis
Cc: mgrover

                
> Resources on non-local file system should be downloaded to temporary directory sometimes
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-3431
>                 URL: https://issues.apache.org/jira/browse/HIVE-3431
>             Project: Hive
>          Issue Type: Improvement
>          Components: Configuration
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Trivial
>         Attachments: HIVE-3431.1.patch.txt, HIVE-3431.D5199.2.patch
>
>
> "add resource <remote-uri>" command downloads the resource file to location specified
by conf "hive.downloaded.resources.dir" in local file system. But when the command above is
executed concurrently to hive-server for same file, some client fails by VM crash, which is
caused by overwritten file by other requests.
> So there should be a configuration to provide per request location for add resource command,
something like "set hiveconf:hive.downloaded.resources.dir=temporary"

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message