hivemall-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Takeshi Yamamuro (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVEMALL-88) Support a function to flatten a nested schema
Date Thu, 16 Mar 2017 15:24:41 GMT

    [ https://issues.apache.org/jira/browse/HIVEMALL-88?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928262#comment-15928262
] 

Takeshi Yamamuro commented on HIVEMALL-88:
------------------------------------------

Resolved by https://github.com/apache/incubator-hivemall/pull/61

> Support a function to flatten a nested schema
> ---------------------------------------------
>
>                 Key: HIVEMALL-88
>                 URL: https://issues.apache.org/jira/browse/HIVEMALL-88
>             Project: Hivemall
>          Issue Type: Improvement
>            Reporter: Takeshi Yamamuro
>              Labels: Spark
>
> Since parquet is first-citizen in Spark, most of users use nested schemas in DF. In some
usecases, they need to flatten nested schemas into flat ones to dump data into the other systems
that do not support nested schemas, e.g., RDBMS. So, it is useful to support conversion function
from nested schemas to flat ones.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message