hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Colin Patrick McCabe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9912) globStatus of a symlink to a directory does not report symlink as a directory
Date Tue, 03 Sep 2013 19:07:52 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756934#comment-13756934

Colin Patrick McCabe commented on HADOOP-9912:

The shell needs to be able to "see" symlinks, not just the files they point to.  However,
we don't want to break Pig and other programs that are relying on the old behavior.

Jason wrote:
bq. Is it unreasonable to have listStatus resolve symlinks and provide a separate API or flag
for symlink-aware clients?

I think you meant to say {{globStatus}}?  If so, I agree... let's add a flag to {{globStatus}},
{{resolveLinks}}, which controls whether symlinks are fully resolved.  We can default it to
{{true}}, for maximum compatibility.

Daryn wrote:
bq. ... calls in Globber are trapping IOException and returning null. This unexpectedly causes
file not found exceptions.

This is a separate topic.  Check out HADOOP-9929.  The solution to this is going to be complicated,
since the probably want to throw an exception only when listing a single file rather than
a glob.  (Imagine if your ls /* threw an exception because you lacked permission for one directory
in / out of 1000... not good.)
> globStatus of a symlink to a directory does not report symlink as a directory
> -----------------------------------------------------------------------------
>                 Key: HADOOP-9912
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9912
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>            Priority: Blocker
>         Attachments: HADOOP-9912-testcase.patch
> globStatus for a path that is a symlink to a directory used to report the resulting FileStatus
as a directory but recently this has changed.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message