Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Wed, 19 Jul 2017 19:01:00 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.13087091.1500011506000.284911.1500490860137@Atlassian.JIRA>
In-Reply-To: <JIRA.13087091.1500011506000@Atlassian.JIRA>
References: <JIRA.13087091.1500011506000@Atlassian.JIRA> <JIRA.13087091.1500011506564@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect
 pathSuffix for path of file
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Wed, 19 Jul 2017 19:01:05 -0000


    [ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093616#comment-16093616 ] 

Hudson commented on HDFS-12139:
-------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12034 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/12034/])
HDFS-12139. HTTPFS liststatus returns incorrect pathSuffix for path of (yzhang: rev 3556e36be30211f46ac38899ce11a4d4cac6d635)
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
* (edit) hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java


> HTTPFS liststatus returns incorrect pathSuffix for path of file
> ---------------------------------------------------------------
>
>                 Key: HDFS-12139
>                 URL: https://issues.apache.org/jira/browse/HDFS-12139
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: httpfs
>            Reporter: Yongjun Zhang
>            Assignee: Yongjun Zhang
>         Attachments: HDFS-12139.001.patch, HDFS-12139.002.patch
>
>
> Per the following logs, we can see that liststatus returns the same pathSuffix "test.txt" for  /tmp/yj/yj1 and /tmp/yj/yj1/test.txt, which is wrong. The pathSuffix for the latter should be empty. 
> {code}
> [thost ~]$ hadoop fs -copyFromLocal test.txt /tmp/yj/yj1
> [thost ~]$ curl "http://thost.x.y:14000/webhdfs/v1/tmp/yj/yj1?op=LISTSTATUS&user.name=tuser"
> {"FileStatuses":{"FileStatus":[{"pathSuffix":"test.txt","type":"FILE","length":16,"owner":"tuser","group":"supergroup","permission":"644","accessTime":1500007684989,"modificationTime":1500007685286,"blockSize":134217728,"replication":3}]}}
> [thost ~]$ curl "http://thost.x.y:14000/webhdfs/v1/tmp/yj/yj1/test.txt?op=LISTSTATUS&user.name=tuser"
> {"FileStatuses":{"FileStatus":[{"pathSuffix":"test.txt","type":"FILE","length":16,"owner":"tuser","group":"supergroup","permission":"644","accessTime":1500007684989,"modificationTime":1500007685286,"blockSize":134217728,"replication":3}]}}
> {code}
> Due to this bug, the symptom of running distcp with httpfs to copy a single file /tmp/test.txt is:
> {quote}
> WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:systest (auth:PROXY) via httpfs (auth:SIMPLE) cause:org.apache.hadoop.security.AccessControlException: Permission denied: user=systest, access=EXECUTE, inode="/tmp/test.txt":systest:supergroup:-rw-r--r-- (Ancestor /tmp/test.txt is not a directory).
> {quote}
> because /tmp/test.txt is treated as /tmp/test.txt/test.txt.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org