Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 809B0200BB6 for ; Fri, 21 Oct 2016 04:12:50 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 7F326160AF2; Fri, 21 Oct 2016 02:12:50 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BE9D5160AE0 for ; Fri, 21 Oct 2016 04:12:49 +0200 (CEST) Received: (qmail 60975 invoked by uid 500); 21 Oct 2016 02:12:49 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 60958 invoked by uid 99); 21 Oct 2016 02:12:48 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2016 02:12:48 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 78B50DFBA8; Fri, 21 Oct 2016 02:12:48 +0000 (UTC) From: cloud-fan To: reviews@spark.apache.org Reply-To: reviews@spark.apache.org References: In-Reply-To: Subject: [GitHub] spark pull request #15539: [SPARK-17994] [SQL] Add back a file status cache ... Content-Type: text/plain Message-Id: <20161021021248.78B50DFBA8@git1-us-west.apache.org> Date: Fri, 21 Oct 2016 02:12:48 +0000 (UTC) archived-at: Fri, 21 Oct 2016 02:12:50 -0000 Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15539#discussion_r84409377 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/ListingFileCatalog.scala --- @@ -64,11 +66,18 @@ class ListingFileCatalog( } override def refresh(): Unit = { + refresh0(true) --- End diff -- nit: instead of having a parameter in `refresh0`, can we just call `refresh0` here, and then invalidate the file status cache? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org