Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F2138184F5 for ; Tue, 28 Jul 2015 02:15:04 +0000 (UTC) Received: (qmail 72316 invoked by uid 500); 28 Jul 2015 02:15:04 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 72279 invoked by uid 500); 28 Jul 2015 02:15:04 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 72268 invoked by uid 500); 28 Jul 2015 02:15:04 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 72265 invoked by uid 99); 28 Jul 2015 02:15:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Jul 2015 02:15:04 +0000 Date: Tue, 28 Jul 2015 02:15:04 +0000 (UTC) From: "Micah Whitacre (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CRUNCH-551) Make the use of Configuration objects inside of CrunchRecordReader/CrunchInputSplit consistent MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CRUNCH-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643760#comment-14643760 ] Micah Whitacre commented on CRUNCH-551: --------------------------------------- +1 > Make the use of Configuration objects inside of CrunchRecordReader/CrunchInputSplit consistent > ---------------------------------------------------------------------------------------------- > > Key: CRUNCH-551 > URL: https://issues.apache.org/jira/browse/CRUNCH-551 > Project: Crunch > Issue Type: Bug > Components: Core > Affects Versions: 0.12.0 > Reporter: Josh Wills > Assignee: Josh Wills > Fix For: 0.13.0 > > Attachments: CRUNCH-551.patch > > > Ran into an issue when testing a Crunch-on-Spark pipeline that was caused by an inconsistency in the way we handle Configuration objects inside of CrunchInputSplit and CrunchRecordReader. Basically, we can have different Configuration objects in play at different parts of the InputFormat/InputSplit initialization process depending on when/how the split is deserialized and initialized. -- This message was sent by Atlassian JIRA (v6.3.4#6332)