hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-hudi] xushiyan commented on issue #1436: [HUDI-711] Refactor exporter main logic
Date Sun, 22 Mar 2020 17:16:08 GMT
xushiyan commented on issue #1436: [HUDI-711] Refactor exporter main logic
URL: https://github.com/apache/incubator-hudi/pull/1436#issuecomment-602241726
 
 
   > We should use `SparkSession` as possible, `SparkSession` is the unified entry point
of Spark.
   
   @lamber-ken Understand that `SparkSession` is advantageous as Spark entry point. Here I'm
more towards aligning with existing codebase, like HoodieDeltaStreamer, HDFSParquetImporter,
etc, which all use `JavaSparkContext`. When there is a chance (and the need) to upgrade all
to use `SparkSession`, we'd probably do all changes in one shot. Make sense?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message