incubator-crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-52) Writing to a text file with avro types fills a file with the tostring of AvroWrapper
Date Wed, 05 Sep 2012 21:57:07 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-52?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills updated CRUNCH-52:
-----------------------------

    Attachment: 0001-CRUNCH-52-Determine-the-output-format-to-use-based-o.patch

This was my take on it-- I took the AvroOutputFormat you created, but used the PType passed
to configureMapReduce to determine which OutputFormat to use, instead of hardcoding it in
the FileTargetImpl. Should work the same way and doesn't have any issues w/backwards compatibility.
                
> Writing to a text file with avro types fills a file with the tostring of AvroWrapper
> ------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-52
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-52
>             Project: Crunch
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Robert Chu
>            Assignee: Rahul Sharma
>         Attachments: 0001-CRUNCH-52-Determine-the-output-format-to-use-based-o.patch,
CRUNCH-52.patch
>
>
> Currently when writing a pcollection to a text file (provided by To.textFile(...)) TextOutputFormat
doesn't unwrap avro types.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message