crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-313) Copy Configuration object used for reading in CrunchInputSplit
Date Sat, 21 Dec 2013 01:17:11 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills updated CRUNCH-313:
------------------------------

    Attachment: CRUNCH-313.patch

Patch to copy the Configuration object in the CrunchInputSplit and a test that fails without
it.

> Copy Configuration object used for reading in CrunchInputSplit
> --------------------------------------------------------------
>
>                 Key: CRUNCH-313
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-313
>             Project: Crunch
>          Issue Type: Bug
>    Affects Versions: 0.9.0, 0.8.2
>            Reporter: Josh Wills
>             Fix For: 0.10.0, 0.8.3
>
>         Attachments: CRUNCH-313.patch
>
>
> Ran into an issue where the settings for the FormatBundle used in for reading in the
inputs can conflict with other settings for the job (e.g., the AvroMode used for serializing
data during the shuffle.) This changes fixes those problems by copying the Configuration object
used by the CrunchInputSplit so they don't interfere with the settings for the rest of the
job.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message