Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B41B1200BE0 for ; Sat, 3 Dec 2016 03:02:43 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id B2B2D160B24; Sat, 3 Dec 2016 02:02:43 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F3D23160AF6 for ; Sat, 3 Dec 2016 03:02:42 +0100 (CET) Received: (qmail 37120 invoked by uid 500); 3 Dec 2016 02:02:42 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 37091 invoked by uid 99); 3 Dec 2016 02:02:41 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 03 Dec 2016 02:02:41 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id BA970E055E; Sat, 3 Dec 2016 02:02:41 +0000 (UTC) From: ericl To: reviews@spark.apache.org Reply-To: reviews@spark.apache.org References: In-Reply-To: Subject: [GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta... Content-Type: text/plain Message-Id: <20161203020241.BA970E055E@git1-us-west.apache.org> Date: Sat, 3 Dec 2016 02:02:41 +0000 (UTC) archived-at: Sat, 03 Dec 2016 02:02:43 -0000 Github user ericl commented on the issue: https://github.com/apache/spark/pull/16090 Fixed by adding a private cache to `Datasource`, which is used to avoid the duplicate file reads with InMemoryIndex. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org