hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9500) Support nested structs over 24 levels.
Date Thu, 29 Jan 2015 17:06:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297139#comment-14297139
] 

Thejas M Nair commented on HIVE-9500:
-------------------------------------

[~aihuaxu] Thanks for clarifying that the input is actually in Avro format. What part of query
processing is the error happening ? Is it during some internal serialization that LazySimpleSerde
is getting used ? If that is the case, maybe we should fix hive to use a better serde there.



> Support nested structs over 24 levels.
> --------------------------------------
>
>                 Key: HIVE-9500
>                 URL: https://issues.apache.org/jira/browse/HIVE-9500
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Aihua Xu
>              Labels: SerDe
>
> Customer has deeply nested avro structure and is receiving the following error when performing
queries.
> 15/01/09 20:59:29 ERROR ql.Driver: FAILED: SemanticException org.apache.hadoop.hive.serde2.SerDeException:
Number of levels of nesting supported for LazySimpleSerde is 23 Unable to work with level
24
> Currently we support up to 24 levels of nested structs when hive.serialization.extend.nesting.levels
is set to true, while the customers have the requirement to support more than that. 
> It would be better to make the supported levels configurable or completely removed (i.e.,
we can support any number of levels). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message