hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
Date Tue, 03 Sep 2013 18:23:53 GMT

    [ https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756866#comment-13756866
] 

Daniel Dai commented on HIVE-4441:
----------------------------------

[~thejas]
DistributedFileSystem.getHomeDirectory() has annoying makeQualified():
{code}
return new Path("/user/" + dfs.ugi.getShortUserName()).makeQualified(this);
{code}
I don't find a hdfs method which can give us the simple form without "qualified"

[~ekoifman]
For s3 file system, if user specify "statusdir=s3://myoutput", user mean for absolute path.
However, "s3://myoutput" is a relative path as per hdfs (isAbsolute()==false). But we cannot
convert it into "s3://user/xxxx/myoutput" since s3://user does not belong to the user. So
here we skip s3/asv filesystem.

e2e tests is included in HIVE-5078 (eg:Pig_9, which we check the location of stdout/stderr/syslog
file). Sorry for the confusion.
                
> [HCatalog] WebHCat does not honor user home directory
> -----------------------------------------------------
>
>                 Key: HIVE-4441
>                 URL: https://issues.apache.org/jira/browse/HIVE-4441
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>            Reporter: Daniel Dai
>         Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I would expect
results to be stored in the folder relative to the user A's home folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d statusdir="pokes.output"
'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message