hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10324) Hive metatool should take table_param_key to allow for changes to avro serde's schema url key
Date Thu, 16 Apr 2015 04:56:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14497557#comment-14497557
] 

Szehon Ho commented on HIVE-10324:
----------------------------------

Thanks! +1

> Hive metatool should take table_param_key to allow for changes to avro serde's schema
url key
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-10324
>                 URL: https://issues.apache.org/jira/browse/HIVE-10324
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 1.1.0
>            Reporter: Szehon Ho
>            Assignee: Ferdinand Xu
>         Attachments: HIVE-10324.1.patch, HIVE-10324.patch, HIVE-10324.patch.WIP
>
>
> HIVE-3443 added support to change the serdeParams from 'metatool updateLocation' command.
> However, in avro it is possible to specify the schema via the tableParams:
> {noformat}
> CREATE  TABLE `testavro`(
>   `test` string COMMENT 'from deserializer')
> ROW FORMAT SERDE 
>   'org.apache.hadoop.hive.serde2.avro.AvroSerDe' 
> STORED AS INPUTFORMAT 
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' 
> OUTPUTFORMAT 
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
> TBLPROPERTIES (
>   'avro.schema.url'='hdfs://namenode:8020/tmp/test.avsc', 
>   'kite.compression.type'='snappy', 
>   'transient_lastDdlTime'='1427996456')
> {noformat}
> Hence for those tables the 'metatool updateLocation' will not help.
> This is necessary in case like upgrade the namenode to HA where the absolute paths have
changed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message