avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Kleppmann <mar...@rapportive.com>
Subject Re: Union in AvroMapper.map: Not in Union??
Date Wed, 10 Apr 2013 20:30:17 GMT
On 10 April 2013 11:47, Doug Cutting <cutting@apache.org> wrote:

> On Tue, Apr 9, 2013 at 8:55 PM, Martin Kleppmann <martin@rapportive.com>wrote:
>
>> AvroJob does not perform schema evolution, so the schema you provide
>> to AvroJob.setInputSchema has to be the exact same schema with which
>> your input files to the mappers are encoded.
>>
>
> Actually the schema you provide is used as the "reader" schema and need
> not exactly match the schema used to write the data.  The schema used when
> writing is stored in the data files.
>

Oh yes — sorry, I misread the code. (I overlooked the fact that
DataFileStream.initialize mutates the reader to use the writer's schema.)

Martin

Mime
View raw message