hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9912) globStatus of a symlink to a directory does not report symlink as a directory
Date Fri, 06 Sep 2013 07:39:54 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760020#comment-13760020

Colin Patrick McCabe commented on HADOOP-9912:

Hi all.  There's been some confusion about old and new behavior, so I created a test program
so you can see for yourself.  Then I ran it on a very old branch-2 derived Hadoop (CDH 4.0.0,
in fact), as well as current trunk.  The old branch is from June 2012.

The summary:
* on HDFS, the behavior of listStatus *has always been* not resolving symlinks.  Ever since
Eli added the feature a few years ago.  It has never dereferenced.
* on HDFS, {{globStatus}} was previously inconsistent about whether symlinks that were the
last path component were dereferenced-- sometimes they were, other times not.  Now they are
never dereferenced.
* on LocalFileSystem, {{getFileLinkStatus}} previously did the exact same thing as {{getFileStatus}}
(oops!)  This *bug* was fixed, and now calling {{getFileLinkStatus}} on a symlink allows you
to identify it as a symlink.
* {{LocalFS}} had a bug then, which it apparently stil has, where {{listStatus}} doesn't list
dangling symlinks at all.  Hopefully we'll be able to fix this bug without people asking for
the old broken behavior.
* There are some other irregularities in {{LocalFS}}.  In general symlink support seems very
poor in LocalFS.

the test program is up on github at https://github.com/cmccabe/HADOOP-9912_test
> globStatus of a symlink to a directory does not report symlink as a directory
> -----------------------------------------------------------------------------
>                 Key: HADOOP-9912
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9912
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>            Priority: Blocker
>         Attachments: HADOOP-9912-testcase.patch
> globStatus for a path that is a symlink to a directory used to report the resulting FileStatus
as a directory but recently this has changed.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message