Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 305DE200B3B for ; Mon, 11 Jul 2016 20:03:13 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2F124160A5E; Mon, 11 Jul 2016 18:03:13 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A7D5C160A78 for ; Mon, 11 Jul 2016 20:03:12 +0200 (CEST) Received: (qmail 22132 invoked by uid 500); 11 Jul 2016 18:03:11 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 22007 invoked by uid 99); 11 Jul 2016 18:03:11 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Jul 2016 18:03:11 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 262042C02AD for ; Mon, 11 Jul 2016 18:03:11 +0000 (UTC) Date: Mon, 11 Jul 2016 18:03:11 +0000 (UTC) From: "Jerry He (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-15291) FileSystem not closed in secure bulkLoad MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 11 Jul 2016 18:03:13 -0000 [ https://issues.apache.org/jira/browse/HBASE-15291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371299#comment-15371299 ] Jerry He commented on HBASE-15291: ---------------------------------- There is a race condition caused by this fix and it is risky. For example, the same region server hosting two regions: region1 and region2. Secure bulkload calls into both region1 and region2. The calls are from the same UGI so they will share the same fs. If one region finishes earlier, it will close the bulk load fs, and the other region will fail. > FileSystem not closed in secure bulkLoad > ---------------------------------------- > > Key: HBASE-15291 > URL: https://issues.apache.org/jira/browse/HBASE-15291 > Project: HBase > Issue Type: Bug > Affects Versions: 1.0.2, 0.98.16.1 > Reporter: Yong Zhang > Assignee: Yong Zhang > Fix For: 2.0.0, 1.3.0, 1.2.1, 0.98.18, 1.4.0 > > Attachments: HBASE-15291.001.patch, HBASE-15291.002.patch, HBASE-15291.003.patch, HBASE-15291.004.patch, HBASE-15291.addendum, patch > > > FileSystem not closed in secure bulkLoad after bulkLoad finish, it will cause memory used more and more if too many bulkLoad . -- This message was sent by Atlassian JIRA (v6.3.4#6332)