crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-461) Ensure the CombineFileInputFormat is configured w/inputConf properties on a Source
Date Sat, 09 Aug 2014 00:50:12 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills updated CRUNCH-461:
------------------------------

    Attachment: CRUNCH-461.patch

Patch for the same.

> Ensure the CombineFileInputFormat is configured w/inputConf properties on a Source
> ----------------------------------------------------------------------------------
>
>                 Key: CRUNCH-461
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-461
>             Project: Crunch
>          Issue Type: Bug
>            Reporter: Josh Wills
>         Attachments: CRUNCH-461.patch
>
>
> Ran into an issue where the mapred.min.split.size wasn't being respected by the CombineFileInputFormat
when it was specified via the inputConf options on the Source. This happens b/c the CombineFileInputFormat
doesn't use the version of the JobContext that has been configured w/the Source-specific inputConf
information. The fix is tiny.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message