Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D7A4C17C74 for ; Mon, 2 Feb 2015 16:58:32 +0000 (UTC) Received: (qmail 99617 invoked by uid 500); 2 Feb 2015 16:57:35 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 99579 invoked by uid 500); 2 Feb 2015 16:57:35 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 99567 invoked by uid 500); 2 Feb 2015 16:57:35 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 99564 invoked by uid 99); 2 Feb 2015 16:57:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 02 Feb 2015 16:57:35 +0000 Date: Mon, 2 Feb 2015 16:57:35 +0000 (UTC) From: "Tom White (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Reopened] (CRUNCH-481) Support independent output committers for multiple outputs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CRUNCH-481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White reopened CRUNCH-481: ------------------------------ Looks like this didn't get committed. I can't see it in the commit log, and the test in https://issues.cloudera.org/browse/CDK-756 is still failing. > Support independent output committers for multiple outputs > ---------------------------------------------------------- > > Key: CRUNCH-481 > URL: https://issues.apache.org/jira/browse/CRUNCH-481 > Project: Crunch > Issue Type: Bug > Components: Core > Reporter: Aniket Kulkarni > Assignee: Josh Wills > Priority: Minor > Fix For: 0.12.0 > > Attachments: CRUNCH-481.patch > > > I faced this issue while trying to write to Kite and HDFS in the same pipeline. A similar issue was logged for Kite[1][2]. > I was attempting to write a PCollection to Kite and a different PTable to HDFS as a text file. The write to Kite succeeded, however the write to HDFS only produced a _SUCCESS file with no text file. > Commenting out the write to Kite seems to solve the issue and I can see the text file being written. > [1] - https://issues.cloudera.org/browse/CDK-756 > [2] - http://mail-archives.apache.org/mod_mbox/crunch-dev/201401.mbox/%3CCAF-WD4QCUe0Toh3qewpDNnom3u786PVJLgH7T6Go_AbcTpLTaw@mail.gmail.com%3E -- This message was sent by Atlassian JIRA (v6.3.4#6332)