hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9912) globStatus of a symlink to a directory does not report symlink as a directory
Date Fri, 20 Sep 2013 20:30:54 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773377#comment-13773377
] 

Daryn Sharp commented on HADOOP-9912:
-------------------------------------

We also need to revert most of HADOOP-9817, or at least change the new {{Globber}} class to
behave identically (although resolving symlinks) to how it did before being split out of FileSystem.

The new implementation is causing increased RPC load by listing parent directories when no
patterns are present in the component.  We've had apps go OOM, or run extremely slowly, because
parent dirs had lots of items.

Plus multiple exceptions are now erroneously being reported as FNF, etc.  Ex. I know of at
least AccessControlException (I think Colin fixed?) and StandbyException but I think we encountered
more.
                
> globStatus of a symlink to a directory does not report symlink as a directory
> -----------------------------------------------------------------------------
>
>                 Key: HADOOP-9912
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9912
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.1.0-beta
>            Reporter: Jason Lowe
>            Priority: Blocker
>         Attachments: HADOOP-9912-testcase.patch, new-hdfs.txt, new-local.txt, old-hdfs.txt,
old-local.txt
>
>
> globStatus for a path that is a symlink to a directory used to report the resulting FileStatus
as a directory but recently this has changed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message