crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CRUNCH-551) Make the use of Configuration objects inside of CrunchRecordReader/CrunchInputSplit consistent
Date Tue, 28 Jul 2015 02:36:04 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills resolved CRUNCH-551.
-------------------------------
    Resolution: Fixed

Pushed to master.

> Make the use of Configuration objects inside of CrunchRecordReader/CrunchInputSplit consistent
> ----------------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-551
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-551
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Josh Wills
>            Assignee: Josh Wills
>             Fix For: 0.13.0
>
>         Attachments: CRUNCH-551.patch
>
>
> Ran into an issue when testing a Crunch-on-Spark pipeline that was caused by an inconsistency
in the way we handle Configuration objects inside of CrunchInputSplit and CrunchRecordReader.
Basically, we can have different Configuration objects in play at different parts of the InputFormat/InputSplit
initialization process depending on when/how the split is deserialized and initialized.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message