drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-1613) Drill does not honor nested schema changes
Date Thu, 30 Oct 2014 18:08:34 GMT
Hanifi Gunes created DRILL-1613:

             Summary: Drill does not honor nested schema changes
                 Key: DRILL-1613
                 URL: https://issues.apache.org/jira/browse/DRILL-1613
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Hanifi Gunes
            Assignee: Hanifi Gunes

Drill's current definition of schema change is an incremental update to the top-level schema
structure. This is inappropriate for complex data types where schema change may occur at any
level in the hierarchy of vectors. Current design does not fit into this requirement neatly
as only top-level containers are able to mutate the schema. We need a minor to major re-design
to handle this situation.

This issue exacerbates when querying partitions or batches of files that do not necessarily
conform to the exact same schema. New fields from upcoming batches will be omitted in either

This message was sent by Atlassian JIRA

View raw message