hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wong (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HUDI-614) EMR Presto cannot read Hudi tables saved to S3
Date Wed, 26 Feb 2020 17:23:00 GMT

    [ https://issues.apache.org/jira/browse/HUDI-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17045727#comment-17045727
] 

Andrew Wong commented on HUDI-614:
----------------------------------

I found the problem. We had client-side encryption configured for Spark & Hive using EMRFS,
but not for Presto. Can close this issue.

> EMR Presto cannot read Hudi tables saved to S3
> ----------------------------------------------
>
>                 Key: HUDI-614
>                 URL: https://issues.apache.org/jira/browse/HUDI-614
>             Project: Apache Hudi (incubating)
>          Issue Type: Bug
>    Affects Versions: 0.5.0, 0.5.1
>            Reporter: Andrew Wong
>            Priority: Major
>
> Original issue: [https://github.com/apache/incubator-hudi/issues/1329]
> Code I tried: [https://gist.github.com/popart/c16a4661528fe1819aa63a1fed351e0c,] based
off of [https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hudi-work-with-dataset.html]. 
> In AWS EMR 5.28.0 & 5.28.0, attempting to query a hudi table from Presto results
in the error: Could not find partitionDepth in partition metafile. Querying from Spark or
Hive works as expected.
> This problem does not occur when using HDFS.
> cc: [~bhasudha]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message