From commits-return-13985-archive-asf-public=cust-asf.ponee.io@hudi.apache.org Sun Mar 22 17:16:09 2020 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 515E0180645 for ; Sun, 22 Mar 2020 18:16:09 +0100 (CET) Received: (qmail 27481 invoked by uid 500); 22 Mar 2020 17:16:08 -0000 Mailing-List: contact commits-help@hudi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hudi.apache.org Delivered-To: mailing list commits@hudi.apache.org Received: (qmail 27472 invoked by uid 99); 22 Mar 2020 17:16:08 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 22 Mar 2020 17:16:08 +0000 From: GitBox To: commits@hudi.apache.org Subject: [GitHub] [incubator-hudi] xushiyan commented on issue #1436: [HUDI-711] Refactor exporter main logic Message-ID: <158489736856.15032.6307022525949939496.gitbox@gitbox.apache.org> References: In-Reply-To: Date: Sun, 22 Mar 2020 17:16:08 -0000 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit xushiyan commented on issue #1436: [HUDI-711] Refactor exporter main logic URL: https://github.com/apache/incubator-hudi/pull/1436#issuecomment-602241726 > We should use `SparkSession` as possible, `SparkSession` is the unified entry point of Spark. @lamber-ken Understand that `SparkSession` is advantageous as Spark entry point. Here I'm more towards aligning with existing codebase, like HoodieDeltaStreamer, HDFSParquetImporter, etc, which all use `JavaSparkContext`. When there is a chance (and the need) to upgrade all to use `SparkSession`, we'd probably do all changes in one shot. Make sense? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org With regards, Apache Git Services