avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <lewis.mcgibb...@gmail.com>
Subject Re: Handling data migration/schema evolution in Avro
Date Mon, 12 May 2014 01:56:47 GMT
This seems more complex indeed. I've been reading as much as I can on this
topic recently and haven't seen anything testing such use cases...
For reference I thought it may be useful for other here for me to mention
the koji documentation on schema evolution... I found this a very helpful
I am sorry I don't have an answer right now... my use cases haven't come
this far down the schema evolution road yet!
On May 11, 2014 7:31 AM, "Klaus Kraft" <kl.kraft85@gmail.com> wrote:

> Hi all,
> I know that Avro supports schema evolution when it comes to adding,
> deleting or renaming fields. However, I wondered whether it is possible to
> deal with more complex evolution scenarios too, e.g. what if I want to move
> a field to another record or what if I split one field into two fields or
> merge two fields into one etc.
> Is there any way to handle such scenarios in Avro? The most important
> aspect is that I don't want to lose data. Is it possible to write explicit
> migration classes in Java (thats the target programming language I am
> using) or can't Avro deal with such scenarios?
> Thanks in advance.

View raw message