hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] jinshuangxian commented on issue #954: org.apache.hudi.org.apache.hadoop_hive.metastore.api.NoSuchObjectException: <hivedb.tableName> table not found
Date Fri, 14 Feb 2020 08:56:19 GMT
jinshuangxian commented on issue #954:  org.apache.hudi.org.apache.hadoop_hive.metastore.api.NoSuchObjectException:
<hivedb.tableName> table not found
URL: https://github.com/apache/incubator-hudi/issues/954#issuecomment-586161952
 
 
   > @gfn9cho you are right Glue Catalog does not support Primary Key. Its not actually
a problem with Glue service, but its EMR's glue client implementation that returns a null
because primary key is not supported. Hive is not able to deal with it correctly.
   > Hi, is there a new version of aws-glue-data-catalog-client-for-apache-hive-metastore
   > At this point, we cannot just give you something that would make it work. Please not,
at this point Hudi is not an officially support application on EMR. It should be supported
by mid/end of November, which is when this issue will be fixed in EMRs side as well.
   > 
   > If you cannot wait until then, here is one way to unblock yourself:
   > 
   > * Checkout glue catalog client package which is open sourced, and modify this line
to return an empty list instead: https://github.com/awslabs/aws-glue-data-catalog-client-for-apache-hive-metastore/blob/master/aws-glue-datacatalog-hive2-client/src/main/java/com/amazonaws/glue/catalog/metastore/AWSCatalogMetastoreClient.java#L1630
   > * SSH to EMR master and replace the jar under `/usr/share/aws/hmclient/lib/`
   > * Restart hive-server2 to pick up new library: `sudo stop hive-server2` `sudo start
hive-server2`
   
   
   
   > @gfn9cho you are right Glue Catalog does not support Primary Key. Its not actually
a problem with Glue service, but its EMR's glue client implementation that returns a null
because primary key is not supported. Hive is not able to deal with it correctly.
   > 
   > At this point, we cannot just give you something that would make it work. Please not,
at this point Hudi is not an officially support application on EMR. It should be supported
by mid/end of November, which is when this issue will be fixed in EMRs side as well.
   > 
   > If you cannot wait until then, here is one way to unblock yourself:
   > 
   > * Checkout glue catalog client package which is open sourced, and modify this line
to return an empty list instead: https://github.com/awslabs/aws-glue-data-catalog-client-for-apache-hive-metastore/blob/master/aws-glue-datacatalog-hive2-client/src/main/java/com/amazonaws/glue/catalog/metastore/AWSCatalogMetastoreClient.java#L1630
   > * SSH to EMR master and replace the jar under `/usr/share/aws/hmclient/lib/`
   > * Restart hive-server2 to pick up new library: `sudo stop hive-server2` `sudo start
hive-server2`
   
   Hi, is there a new version of aws-glue-data-catalog-client-for-apache-hive-metastore´╝č

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message