Return-Path: X-Original-To: apmail-spark-reviews-archive@minotaur.apache.org Delivered-To: apmail-spark-reviews-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 37A6D19665 for ; Thu, 26 May 2016 07:30:01 +0000 (UTC) Received: (qmail 31560 invoked by uid 500); 26 May 2016 07:29:56 -0000 Delivered-To: apmail-spark-reviews-archive@spark.apache.org Received: (qmail 31537 invoked by uid 500); 26 May 2016 07:29:56 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 31525 invoked by uid 99); 26 May 2016 07:29:55 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 May 2016 07:29:55 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id A772CDFC13; Thu, 26 May 2016 07:29:55 +0000 (UTC) From: ericl To: reviews@spark.apache.org Reply-To: reviews@spark.apache.org References: In-Reply-To: Subject: [GitHub] spark pull request: [SPARK-15391] [SQL] manage the temporary memor... Content-Type: text/plain Message-Id: <20160526072955.A772CDFC13@git1-us-west.apache.org> Date: Thu, 26 May 2016 07:29:55 +0000 (UTC) Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/13318#discussion_r64701761 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleInMemorySorter.java --- @@ -101,14 +94,17 @@ public void expandPointerArray(LongArray newArray) { array.getBaseOffset(), newArray.getBaseObject(), newArray.getBaseOffset(), - array.size() * (8 / memoryAllocationFactor) + pos * 8 --- End diff -- I think we should keep the memoryAllocationFactor variable, to make it more clear we are overallocating on purpose. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org