From reviews-return-964150-archive-asf-public=cust-asf.ponee.io@spark.apache.org Tue Nov 12 09:57:40 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id F1619180656 for ; Tue, 12 Nov 2019 10:57:39 +0100 (CET) Received: (qmail 197 invoked by uid 500); 12 Nov 2019 09:57:39 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 185 invoked by uid 99); 12 Nov 2019 09:57:39 -0000 Received: from ec2-52-202-80-70.compute-1.amazonaws.com (HELO gitbox.apache.org) (52.202.80.70) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Nov 2019 09:57:39 +0000 From: GitBox To: reviews@spark.apache.org Subject: [GitHub] [spark] HyukjinKwon removed a comment on issue #10572: SPARK-12619 Combine small files in a hadoop directory into single split Message-ID: <157355265922.7031.9634748294003498898.gitbox@gitbox.apache.org> Date: Tue, 12 Nov 2019 09:57:39 -0000 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit HyukjinKwon removed a comment on issue #10572: SPARK-12619 Combine small files in a hadoop directory into single split URL: https://github.com/apache/spark/pull/10572#issuecomment-345631774 @jinxing64 Yup but I think I intended to say most cases within Spark datasources are covered by it. Empty files could be skipped by `spark.hadoopRDD.ignoreEmptySplits` and probably most other cases could be covered by `InputFormat` control though. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org