hawq-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Andre Pearce (IG) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HAWQ-1265) Support Complex Hive Schema's
Date Tue, 10 Jan 2017 19:50:58 GMT
Michael Andre Pearce (IG) created HAWQ-1265:

             Summary: Support Complex Hive Schema's
                 Key: HAWQ-1265
                 URL: https://issues.apache.org/jira/browse/HAWQ-1265
             Project: Apache HAWQ
          Issue Type: Improvement
          Components: Hcatalog, PXF
            Reporter: Michael Andre Pearce (IG)
            Assignee: Ed Espino

Currently if in hive you have Avro or other formats, where the schema is complex, you cannot
currently query the fields in the complex object via hcatalog/pxf integration.

In terms of Avro Schema - records, enums and complex arrays, do not work. 

Hive fully supports this complex/object notation, as does many of the other SQL tools in the
Hadoop eco-system (Spark, Impala, Drill).

These all seem to support the same styled solution of using dots for complex object/path negation:

SELECT schema.table.fieldA.nestedRecordFieldS FROM myavrotable;

This message was sent by Atlassian JIRA

View raw message