hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9912) globStatus of a symlink to a directory does not report symlink as a directory
Date Thu, 05 Sep 2013 01:36:52 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758653#comment-13758653

Colin Patrick McCabe commented on HADOOP-9912:

Agree with Binglin that we don't want to follow symlinks in listStatus.  In general, I'd like
to avoid changing HDFS or LocalFileSystem semantics at all.  I also would like to avoid having
LocalFileSystem semantics diverge from HDFS.

Does a webex on Friday (Sep 6) sound good?  If so, I will set up a dial-in number and post
it here.

My suggestion for Pig would be to simply follow symlinks in Pig whenever you find them.  That
is, if {{FileStatus#isSymlink}} is true, call {{FileSystem#getFileStatus}} on the path to
get the target.  That should work on both the new and old Hadoop, and require no other changes.
 (Unless there's something I'm missing here, which is possible...)
> globStatus of a symlink to a directory does not report symlink as a directory
> -----------------------------------------------------------------------------
>                 Key: HADOOP-9912
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9912
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>            Priority: Blocker
>         Attachments: HADOOP-9912-testcase.patch
> globStatus for a path that is a symlink to a directory used to report the resulting FileStatus
as a directory but recently this has changed.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message