hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3753) 'CTAS' and INSERT OVERWRITE send different column names to the underlying SerDe
Date Tue, 11 Dec 2012 04:43:21 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13528663#comment-13528663
] 

Navis commented on HIVE-3753:
-----------------------------

It does not reproduced in trunk. Could you consider upgrading (v0.10.0, which is not yet released)?
                
> 'CTAS' and INSERT OVERWRITE send different column names to the underlying SerDe
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-3753
>                 URL: https://issues.apache.org/jira/browse/HIVE-3753
>             Project: Hive
>          Issue Type: Bug
>          Components: Serializers/Deserializers
>    Affects Versions: 0.9.0
>            Reporter: Matthew Rathbone
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> A good example is with a JSON serde (https://github.com/rathboma/Hive-JSON-Serde-1)
> Here is a simple example of how the two results differ:
> CREATE TABLE foo ROW FORMAT SERDE '....JsonSerDe' SELECT host from table1;
> generates => {"_col0": "localhost"}
> CREATE TABLE foo(host string) ROW FORMAT SERDE '....JsonSerDe';
> INSERT OVERWRITE TABLE FOO SELECT host FROM table;
> generates => {"host": "localhost"}
> The SerDe gets passed column names in two places:
> 1) The property Constants.LIST_COLUMNS
> 2) It gets passed a StructObjectInspector on serialize
> In the CTAS example above, both of these contain '_col0' as the column name. This is
not true in the second example, as the LIST_COLUMNS property contains the real column names.
> I'd be happy to help out with this change, but I fear that the solution lies somewhere
in SemanticAnalyser.java, and I'm having a hard time finding my way around.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message