drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-1613) Drill does not honor nested schema changes
Date Thu, 30 Oct 2014 20:19:35 GMT

    [ https://issues.apache.org/jira/browse/DRILL-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190749#comment-14190749

Hanifi Gunes commented on DRILL-1613:

Will be fixed once DRILL-1324 is in.

> Drill does not honor nested schema changes
> ------------------------------------------
>                 Key: DRILL-1613
>                 URL: https://issues.apache.org/jira/browse/DRILL-1613
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Hanifi Gunes
>            Assignee: Hanifi Gunes
> Drill's current definition of schema change is an incremental update to the top-level
schema structure. This is inappropriate for complex data types where schema change may occur
at any level in the hierarchy of vectors. Current design does not fit into this requirement
neatly as only top-level containers are able to mutate the schema. We need a minor to major
re-design to handle this situation.
> This issue exacerbates when querying partitions or batches of files that do not necessarily
conform to the exact same schema. New fields from upcoming batches will be omitted in either

This message was sent by Atlassian JIRA

View raw message