Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9B2F6200C38 for ; Wed, 1 Mar 2017 04:00:51 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 99C8A160B7E; Wed, 1 Mar 2017 03:00:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 162EC160B7C for ; Wed, 1 Mar 2017 04:00:50 +0100 (CET) Received: (qmail 45444 invoked by uid 500); 1 Mar 2017 03:00:50 -0000 Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list reviews@spark.apache.org Received: (qmail 45432 invoked by uid 99); 1 Mar 2017 03:00:50 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Mar 2017 03:00:50 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id E5860DFDE6; Wed, 1 Mar 2017 03:00:49 +0000 (UTC) From: mallman To: reviews@spark.apache.org Reply-To: reviews@spark.apache.org References: In-Reply-To: Subject: [GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora... Content-Type: text/plain Message-Id: <20170301030049.E5860DFDE6@git1-us-west.apache.org> Date: Wed, 1 Mar 2017 03:00:49 +0000 (UTC) archived-at: Wed, 01 Mar 2017 03:00:51 -0000 Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r103602156 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1018,7 +1025,9 @@ private[spark] class BlockManager( try { replicate(blockId, bytesToReplicate, level, remoteClassTag) } finally { - bytesToReplicate.dispose() + if (!level.useOffHeap) { --- End diff -- Ok. I'll see what else is calling that method to validate that a fix there won't break something else, and I'll add a unit test to validate that calling `StorageUtils.dispose` on a direct byte buffer that isn't memory mapped doesn't actually dispose it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org For additional commands, e-mail: reviews-help@spark.apache.org