hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8205) Using strings in group type fails in ParquetSerDe
Date Sat, 20 Sep 2014 20:22:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142188#comment-14142188
] 

Hive QA commented on HIVE-8205:
-------------------------------



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12670171/HIVE-8205.patch

{color:green}SUCCESS:{color} +1 6298 tests passed

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/899/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/899/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-899/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12670171

> Using strings in group type fails in ParquetSerDe
> -------------------------------------------------
>
>                 Key: HIVE-8205
>                 URL: https://issues.apache.org/jira/browse/HIVE-8205
>             Project: Hive
>          Issue Type: Bug
>          Components: Serializers/Deserializers
>            Reporter: Mohit Sabharwal
>            Assignee: Mohit Sabharwal
>              Labels: parquet
>         Attachments: HIVE-8205.patch
>
>
> In HIVE-7735, schema info was plumbed to ETypeConverter to disambiguate between hive
Char, Varchar and String types, which are all represented as PrimitiveType "binary" and OriginalType
"utf8" in parquet.
> However, this does not work for parquet nested types (that map to hive Array, Map, etc.)
containing these values, because schema lookup for nested values was not implemented.  It's
also non-trivial to do that in the current parquet serde implementation. Instead of plumbing
in the schema, we should convert 
> these types to the same Text writeable and let the object inspectors handle the final
conversion.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message