crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-243) Support easily extensibility for custom reading of Avro Datum
Date Tue, 23 Jul 2013 17:56:57 GMT


Micah Whitacre commented on CRUNCH-243:

Only other change I was toying with would be to add constructors to AvroFileSource and AvroFileSourceTarget
that passes in a DatumReader, so consumers would not need subclassing.
> Support easily extensibility for custom reading of Avro Datum
> -------------------------------------------------------------
>                 Key: CRUNCH-243
>                 URL:
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Micah Whitacre
>            Assignee: Micah Whitacre
>            Priority: Minor
>         Attachments: CRUNCH-243.patch
> Through some discussions on the Avro mailing lists[1], there are use cases that need
the ability to inject a custom SpecificDatumReader.  Crunch does not make it easy to inject
the custom reader as it is currently implemented causing consumers to copy three classes (e.g.
AvroFileSource, AvroFileSourceTarget, AvroFileReaderFactory) to gain this functionality. 
With a few minor changes to AvroFileSource and AvroFileReaderFactory, consumers can inject
their custom reader fairly easily.
> [1] -

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message