kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ewen Cheslack-Postava (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-2484) Add schema projection utilities
Date Thu, 27 Aug 2015 17:58:46 GMT
Ewen Cheslack-Postava created KAFKA-2484:

             Summary: Add schema projection utilities
                 Key: KAFKA-2484
                 URL: https://issues.apache.org/jira/browse/KAFKA-2484
             Project: Kafka
          Issue Type: Sub-task
          Components: copycat
            Reporter: Ewen Cheslack-Postava
            Assignee: Ewen Cheslack-Postava
            Priority: Minor

Since Copycat has support for versioned schemas and connectors may encounter different versions
of the same schema, it will be useful for some connectors to be able to project between different
versions of a schema, or have an automatic way to try to project to a target schema (e.g.
an existing database table the connector is trying to write data to).

These utilities should be pretty small because the complex types we support are fairly limited.
The primary code required will be for Structs. However, we should take care in designing these
utilities since there may be performance implications. For example, when projecting between
two schemas, it would be better to come up with a plan object that can efficiently perform
the project and be able to reuse that plan many times.

This message was sent by Atlassian JIRA

View raw message