Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6C7D4F700 for ; Tue, 30 Apr 2013 05:46:21 +0000 (UTC) Received: (qmail 56920 invoked by uid 500); 30 Apr 2013 05:46:21 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 54995 invoked by uid 500); 30 Apr 2013 05:46:17 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 54013 invoked by uid 500); 30 Apr 2013 05:46:16 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 54001 invoked by uid 99); 30 Apr 2013 05:46:16 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Apr 2013 05:46:16 +0000 Date: Tue, 30 Apr 2013 05:46:16 +0000 (UTC) From: "Josh Wills (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CRUNCH-200) Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CRUNCH-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645290#comment-13645290 ] Josh Wills commented on CRUNCH-200: ----------------------------------- You are quite right-- will integrate that in the AM and commit. > Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects > --------------------------------------------------------------------------------------- > > Key: CRUNCH-200 > URL: https://issues.apache.org/jira/browse/CRUNCH-200 > Project: Crunch > Issue Type: Improvement > Reporter: Josh Wills > Attachments: CRUNCH-200.patch > > > Certain output formats, like Trevni, have a non-standard output file format that requires custom handling logic. Currently, the logic for moving the output of a Crunch job from a temporary place on the filesystem to its final output directory is handled by logic in CrunchJobHooks, but the actual work of moving the files should be delegated to the Target object, which will be aware of how the files are laid out in the filesystem and can move them appropriately. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira