Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D74AD200C4E for ; Thu, 6 Apr 2017 16:52:47 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D5DC8160B83; Thu, 6 Apr 2017 14:52:47 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 31633160B84 for ; Thu, 6 Apr 2017 16:52:47 +0200 (CEST) Received: (qmail 46254 invoked by uid 500); 6 Apr 2017 14:52:46 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 46075 invoked by uid 99); 6 Apr 2017 14:52:46 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Apr 2017 14:52:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D3F1FC0750 for ; Thu, 6 Apr 2017 14:52:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -99.202 X-Spam-Level: X-Spam-Status: No, score=-99.202 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id kbKswSmxvGhg for ; Thu, 6 Apr 2017 14:52:45 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id D79305FDDC for ; Thu, 6 Apr 2017 14:52:43 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id BA8C7E0D1C for ; Thu, 6 Apr 2017 14:52:42 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id BE92A24073 for ; Thu, 6 Apr 2017 14:52:41 +0000 (UTC) Date: Thu, 6 Apr 2017 14:52:41 +0000 (UTC) From: "Anastasia Braginsky (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16438) Create a cell type so that chunk id is embedded in it MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 06 Apr 2017 14:52:48 -0000 [ https://issues.apache.org/jira/browse/HBASE-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15959036#comment-15959036 ] Anastasia Braginsky commented on HBASE-16438: --------------------------------------------- Hey once again! I got now the idea why the seqID shouldn't probably be in the data-chunk's byte-buffer upon Cells creation. If upon snapshot the BBKV is streamed out directly to the hfileblocks so seqIDs must move to disk as well, then this is bad enough to place it in the CellChunkMap and probably decrease its performance. So if this is the issue I agree to accommodate the seqIDs in the CellChunkMap. Please let me know what do you think... > Create a cell type so that chunk id is embedded in it > ----------------------------------------------------- > > Key: HBASE-16438 > URL: https://issues.apache.org/jira/browse/HBASE-16438 > Project: HBase > Issue Type: Sub-task > Affects Versions: 2.0.0 > Reporter: ramkrishna.s.vasudevan > Assignee: ramkrishna.s.vasudevan > Attachments: HBASE-16438_10_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_11_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_1.patch, HBASE-16438_3_ChunkCreatorwrappingChunkPool.patch, HBASE-16438_4_ChunkCreatorwrappingChunkPool.patch, HBASE-16438_8_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_9_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438.patch, MemstoreChunkCell_memstoreChunkCreator_oldversion.patch, MemstoreChunkCell_trunk.patch > > > For CellChunkMap we may need a cell such that the chunk out of which it was created, the id of the chunk be embedded in it so that when doing flattening we can use the chunk id as a meta data. More details will follow once the initial tasks are completed. > Why we need to embed the chunkid in the Cell is described by [~anastas] in this remark over in parent issue https://issues.apache.org/jira/browse/HBASE-14921?focusedCommentId=15244119&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15244119 -- This message was sent by Atlassian JIRA (v6.3.15#6346)