hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types
Date Fri, 10 Jan 2020 07:27:38 GMT
bvaradar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4,
migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types
URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r365101180
 
 

 ##########
 File path: packaging/hudi-hadoop-mr-bundle/pom.xml
 ##########
 @@ -143,17 +143,7 @@
     <dependency>
       <groupId>org.apache.avro</groupId>
       <artifactId>avro</artifactId>
-      <scope>${mr.bundle.avro.scope}</scope>
+      <scope>compile</scope>
     </dependency>
   </dependencies>
-
-  <profiles>
-    <profile>
-      <id>mr-bundle-shade-avro</id>
 
 Review comment:
   (cc @n3nash ) Yeah, this would mean that we need to employ the same package relocation
in the jar carrying custom record payloads. As discussed in the earlier threads, there is
no way around it. @umehrot2 : We would need to document this caveat in Release Notes and add
documentation on how to shade it. Can you create a ticket to track  this ?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message