atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-409) Atlas will not import avro tables with schema read from a file
Date Tue, 19 Jan 2016 06:13:39 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106299#comment-15106299
] 

Shwetha G S commented on ATLAS-409:
-----------------------------------

Committed to master. Thanks Aaron

We should have added test for this, but since this was pending for a long time and its small
patch, I have committed this. Created ATLAS-443 for the test. Hemanth's code above with your
example DDL with some minor changes should be enough for the test. Feel free to take up the
test jira if you are interested. Thanks again

> Atlas will not import avro tables with schema read from a file
> --------------------------------------------------------------
>
>                 Key: ATLAS-409
>                 URL: https://issues.apache.org/jira/browse/ATLAS-409
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: 0.6-incubating
>            Reporter: Aaron Dossett
>            Assignee: Aaron Dossett
>             Fix For: trunk
>
>         Attachments: ATLAS-409-2.patch, ATLAS-409-3.patch, ATLAS-409.patch, example.ddl,
foo.avsc
>
>
> Atlas won't import a Hive table with no columns (see below for an example of a valid
hive table with no explicit columns).  This is because the Atlas Hive Storage Descriptor class
REQUIRES columns, but the Hive Table class allows them to be OPTIONAL.
> {code}
> CREATE TABLE example
>   ROW FORMAT SERDE
>   'org.apache.hadoop.hive.serde2.avro.AvroSerDe'
>   STORED AS INPUTFORMAT
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat'
>   OUTPUTFORMAT
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
>   TBLPROPERTIES (
>     'avro.schema.url'='file:///path/to/the/schema/test_serializer.avsc');
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message