crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-199) Add Source and Target Support for AvroTrevniKey files
Date Mon, 29 Apr 2013 04:52:15 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13644264#comment-13644264
] 

Josh Wills commented on CRUNCH-199:
-----------------------------------

Oh, interesting. So Trevni uses such a different output layout that the CrunchJobHooks have
no idea how to handle it. I guess that's not all that shocking, now that I think about it.
I think one option here would be to move the logic for handling job outputs into the Target
classes themselves, so that they could override the default file-handling logic on an as-needed
basis (as apparently Trevni needs to be able to do.) Will open a JIRA for doing this.
                
> Add Source and Target Support for AvroTrevniKey files
> -----------------------------------------------------
>
>                 Key: CRUNCH-199
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-199
>             Project: Crunch
>          Issue Type: Wish
>          Components: Core, IO
>            Reporter: Micah Whitacre
>            Assignee: Josh Wills
>            Priority: Minor
>         Attachments: CRUNCH-199.patch
>
>
> Add Source, Target, and SourceTarget, support for AvroTrevniKeyInputFormat[1] and AvroTrevniKeyOutputFormat[2].
> [1] - http://avro.apache.org/docs/1.7.4/api/java/org/apache/trevni/avro/mapreduce/AvroTrevniKeyInputFormat.html
> [2] - http://avro.apache.org/docs/1.7.4/api/java/org/apache/trevni/avro/mapreduce/AvroTrevniKeyOutputFormat.html

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message