Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 90FE7200C6B for ; Tue, 2 May 2017 08:54:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8D24D160BAC; Tue, 2 May 2017 06:54:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D4D0A160BA1 for ; Tue, 2 May 2017 08:54:09 +0200 (CEST) Received: (qmail 70690 invoked by uid 500); 2 May 2017 06:54:09 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 70679 invoked by uid 99); 2 May 2017 06:54:08 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 02 May 2017 06:54:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 99386C01DB for ; Tue, 2 May 2017 06:54:08 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.001 X-Spam-Level: X-Spam-Status: No, score=-100.001 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id AsnbKM2OpNPm for ; Tue, 2 May 2017 06:54:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 44D355FC63 for ; Tue, 2 May 2017 06:54:05 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C45E4E0959 for ; Tue, 2 May 2017 06:54:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 8368A21DE4 for ; Tue, 2 May 2017 06:54:04 +0000 (UTC) Date: Tue, 2 May 2017 06:54:04 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-17757) Unify blocksize after encoding to decrease memory fragment MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 02 May 2017 06:54:10 -0000 [ https://issues.apache.org/jira/browse/HBASE-17757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992434#comment-15992434 ] Hudson commented on HBASE-17757: -------------------------------- FAILURE: Integrated in Jenkins build HBase-1.4 #714 (See [https://builds.apache.org/job/HBase-1.4/714/]) HBASE-17757 Unify blocksize after encoding to decrease memory fragment (anoopsamjohn: rev 262c66f614d436c15b47ed4ae2ba33ed913c3cac) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileWriterV2.java > Unify blocksize after encoding to decrease memory fragment > ----------------------------------------------------------- > > Key: HBASE-17757 > URL: https://issues.apache.org/jira/browse/HBASE-17757 > Project: HBase > Issue Type: New Feature > Reporter: Allan Yang > Assignee: Allan Yang > Fix For: 2.0.0, 1.4.0 > > Attachments: HBASE-17757-branch-1.v5.patch, HBASE-17757.patch, HBASE-17757v2.patch, HBASE-17757v3.patch, HBASE-17757v4-branch-1.patch, HBASE-17757v4.patch > > > Usually, we store encoded block(uncompressed) in blockcache/bucketCache. Though we have set the blocksize, after encoding, blocksize is varied. Varied blocksize will cause memory fragment problem, which will result in more FGC finally.In order to relief the memory fragment, This issue adjusts the encoded block to a unified size. -- This message was sent by Atlassian JIRA (v6.3.15#6346)