hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lohit vijayarenu (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2151) FileSyste.globPaths does not validate the return list of Paths
Date Tue, 06 Nov 2007 09:14:50 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

lohit vijayarenu updated HADOOP-2151:

    Attachment: HADOOP-2151.patch

Attached is a patch which addresses this problem. globPaths basically checks if the path exits
by calling exists() for only those paths which were expanded via listPaths in previous iteration.
This is done by passing a new flag for the recursive function to indicating if previous component
was glob or not.

> FileSyste.globPaths does not validate the return list of Paths
> --------------------------------------------------------------
>                 Key: HADOOP-2151
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2151
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.14.3, 0.15.0
>            Reporter: lohit vijayarenu
>             Fix For: 0.16.0
>         Attachments: HADOOP-2151.patch
> FileSystem.globPaths does not validate the return list of Paths.
> Here is an example. 
> Consider a directory structure like
> /user/foo/DIR1/FILE1
> /user/foo/DIR2
> now if we pass an input path like "/user/foo/*/FILE1" to FileSystem.globPaths()
> It returns 2 entries as shown below
> /user/foo/DIR1/FILE1
> /user/foo/DIR2/FILE1
> Should globPaths validate this and return only valid Paths? This behavior was caught
in FileSystem.validateInput() where an IOException is thrown while processing such a directory

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message