hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9912) globStatus of a symlink to a directory does not report symlink as a directory
Date Fri, 06 Sep 2013 07:39:54 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760020#comment-13760020
] 

Colin Patrick McCabe commented on HADOOP-9912:
----------------------------------------------

Hi all.  There's been some confusion about old and new behavior, so I created a test program
so you can see for yourself.  Then I ran it on a very old branch-2 derived Hadoop (CDH 4.0.0,
in fact), as well as current trunk.  The old branch is from June 2012.

The summary:
* on HDFS, the behavior of listStatus *has always been* not resolving symlinks.  Ever since
Eli added the feature a few years ago.  It has never dereferenced.
* on HDFS, {{globStatus}} was previously inconsistent about whether symlinks that were the
last path component were dereferenced-- sometimes they were, other times not.  Now they are
never dereferenced.
* on LocalFileSystem, {{getFileLinkStatus}} previously did the exact same thing as {{getFileStatus}}
(oops!)  This *bug* was fixed, and now calling {{getFileLinkStatus}} on a symlink allows you
to identify it as a symlink.
* {{LocalFS}} had a bug then, which it apparently stil has, where {{listStatus}} doesn't list
dangling symlinks at all.  Hopefully we'll be able to fix this bug without people asking for
the old broken behavior.
* There are some other irregularities in {{LocalFS}}.  In general symlink support seems very
poor in LocalFS.

the test program is up on github at https://github.com/cmccabe/HADOOP-9912_test
                
> globStatus of a symlink to a directory does not report symlink as a directory
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-9912
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9912
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>            Priority: Blocker
>         Attachments: HADOOP-9912-testcase.patch
>
>
> globStatus for a path that is a symlink to a directory used to report the resulting FileStatus
as a directory but recently this has changed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message