crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-200) Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects
Date Tue, 30 Apr 2013 05:46:16 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13645290#comment-13645290
] 

Josh Wills commented on CRUNCH-200:
-----------------------------------

You are quite right-- will integrate that in the AM and commit.
                
> Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects
> ---------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-200
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-200
>             Project: Crunch
>          Issue Type: Improvement
>            Reporter: Josh Wills
>         Attachments: CRUNCH-200.patch
>
>
> Certain output formats, like Trevni, have a non-standard output file format that requires
custom handling logic. Currently, the logic for moving the output of a Crunch job from a temporary
place on the filesystem to its final output directory is handled by logic in CrunchJobHooks,
but the actual work of moving the files should be delegated to the Target object, which will
be aware of how the files are laid out in the filesystem and can move them appropriately.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message