Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 921D2200CA3 for ; Thu, 1 Jun 2017 19:46:07 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 91192160BDF; Thu, 1 Jun 2017 17:46:07 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id D7FA5160BC1 for ; Thu, 1 Jun 2017 19:46:06 +0200 (CEST) Received: (qmail 97528 invoked by uid 500); 1 Jun 2017 17:46:06 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 97517 invoked by uid 99); 1 Jun 2017 17:46:05 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Jun 2017 17:46:05 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 860D0CEC5A for ; Thu, 1 Jun 2017 17:46:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id hGvz25c-dUar for ; Thu, 1 Jun 2017 17:46:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id E7FB55FB8B for ; Thu, 1 Jun 2017 17:46:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 8988DE05F7 for ; Thu, 1 Jun 2017 17:46:04 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 4775421B57 for ; Thu, 1 Jun 2017 17:46:04 +0000 (UTC) Date: Thu, 1 Jun 2017 17:46:04 +0000 (UTC) From: "Jerry He (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HBASE-16261) MultiHFileOutputFormat Enhancement MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 01 Jun 2017 17:46:07 -0000 [ https://issues.apache.org/jira/browse/HBASE-16261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry He updated HBASE-16261: ----------------------------- Resolution: Fixed Status: Resolved (was: Patch Available) > MultiHFileOutputFormat Enhancement > ------------------------------------ > > Key: HBASE-16261 > URL: https://issues.apache.org/jira/browse/HBASE-16261 > Project: HBase > Issue Type: Sub-task > Components: hbase, mapreduce > Affects Versions: 2.0.0 > Reporter: Yi Liang > Assignee: Yi Liang > Fix For: 2.0.0 > > Attachments: HBASE-16261-V1.patch, HBASE-16261-V2.patch, HBASE-16261-V3.patch, HBASE-16261-V4.patch, HBASE-16261-V5.patch, HBase-16261-V6.patch, HBase-16261-V7.patch, HBase-16261-V8.patch, HBase-16261-V9.patch > > > Change MultiHFileOutputFormat to MultiTableHFileOutputFormat, Continuing work to enhance the MultiTableHFileOutputFormat to make it more usable: > MultiTableHFileOutputFormat follow HFileOutputFormat2 > (1) HFileOutputFormat2 can read one table's region split keys. and then output multiple hfiles for one family, and each hfile map to one region. We can add partitioner in MultiTableHFileOutputFormat to make it support this feature. > (2) HFileOutputFormat2 support Customized Compression algorithm for column family and BloomFilter, also support customized DataBlockEncoding for the output hfiles. We can also make MultiTableHFileOutputFormat to support these features. -- This message was sent by Atlassian JIRA (v6.3.15#6346)