hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2055) JobConf should have a setInputPathFilter(PathFilter filter) method
Date Tue, 23 Oct 2007 23:41:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537170
] 

Alejandro Abdelnur commented on HADOOP-2055:
--------------------------------------------

Owen, Doug, got the static methos thing, that would work.

Eric, using wildcards would not work as it allows you to tell what you want to include, but
now what you don't want to include.

For example, if I have some files like the CRC files (to track other type of information)
and I would like to skip them.



> JobConf should have a setInputPathFilter(PathFilter filter) method
> ------------------------------------------------------------------
>
>                 Key: HADOOP-2055
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2055
>             Project: Hadoop
>          Issue Type: New Feature
>         Environment: all
>            Reporter: Alejandro Abdelnur
>            Priority: Minor
>
> It should be possible to set a PathFilter for the input to avoid taking certain files
as input data within the input directories.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message