hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3193) NextGen Mapreduce framework is not able to read the job input recursively.Input is read only for one folder level deep
Date Wed, 19 Oct 2011 06:16:10 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130384#comment-13130384
] 

Arun C Murthy commented on MAPREDUCE-3193:
------------------------------------------

bq. If the input path contains one nested dir, it is considering as file and trying to execute
the task and it fails with the below error. Failing the job itself when the inputpath contains
nested dir might not be correct.

Yes, I realize that.

FileInputFormat has this behaviour for a long while and changing it now (we definitely shouldn't
do this for hadoop-0.23.0) will probably affect a lot of apps. Hence, at the very least, we
need to have this off by default.
                
> NextGen Mapreduce framework is not able to read the job input recursively.Input is read
only for one folder level deep
> ----------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3193
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3193
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>            Assignee: Devaraj K
>         Attachments: MAPREDUCE-3193.patch
>
>
> java.io.FileNotFoundException is thrown,if input file is more than one folder level deep
and the job is getting failed.
> Example:Input file is /r1/r2/input.txt

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message