Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A5021200B76 for ; Tue, 30 Aug 2016 09:07:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A382E160ABA; Tue, 30 Aug 2016 07:07:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E861D160AA8 for ; Tue, 30 Aug 2016 09:07:21 +0200 (CEST) Received: (qmail 64538 invoked by uid 500); 30 Aug 2016 07:07:21 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 64516 invoked by uid 99); 30 Aug 2016 07:07:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Aug 2016 07:07:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id E95FF2C1B7B for ; Tue, 30 Aug 2016 07:07:20 +0000 (UTC) Date: Tue, 30 Aug 2016 07:07:20 +0000 (UTC) From: "Dapeng Sun (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Comment Edited] (HBASE-16463) Improve transparent table/CF encryption with Commons Crypto MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 30 Aug 2016 07:07:22 -0000 [ https://issues.apache.org/jira/browse/HBASE-16463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15448275#comment-15448275 ] Dapeng Sun edited comment on HBASE-16463 at 8/30/16 7:06 AM: ------------------------------------------------------------- I just finished the test of {{HFilePerformanceEvaluation}}, here is the result of cost time. ||codec||cipher||SequentialWriteBenchmark(ms)||UniformRandomSmallScan||UniformRandomReadBenchmark||GaussianRandomReadBenchmark||SequentialReadBenchmark|| |none|none|960|2776|58131|65449|355| |none|Commons|1023|4690|82826|91713|402| |none|JCE|1106|6693|99451|110057|530| |gz|none|1273|7126|104380|108270|349| |gz|Commons|1457|8670|127350|137593|632| |gz|JCE|1665|9880|132759|145476|673| Here is the percentage increase of Commons Crypto compared with default JCE. ||codec||SequentialWriteBenchmark||UniformRandomSmallScan||UniformRandomReadBenchmark||GaussianRandomReadBenchmark||SequentialReadBenchmark|| |none|0.08113392|0.427078891|0.200721996|0.200015265|0.31840796 |gz|0.142759094|0.139561707|0.042473498|0.057292159|0.064873418 We can see Commons CRYPTO compared with JCE, it shows 4%~42% gain. was (Author: dapengsun): I just finished the test of {{HFilePerformanceEvaluation}}, here is the result of cost time. ||codec||cipher||SequentialWriteBenchmark(ms)||UniformRandomSmallScan||UniformRandomReadBenchmark||GaussianRandomReadBenchmark||SequentialReadBenchmark|| |none|none|960|2776|58131|65449|355| |none|Commons|1023|4690|82826|91713|402| |none|JCE|1106|6693|99451|110057|530| |gz|none|1273|7126|104380|108270|349| |gz|Commons|1457|8670|127350|137593|632| |gz|JCE|1665|9880|132759|145476|673| Here is the percentage increase table. ||codec||SequentialWriteBenchmark||UniformRandomSmallScan||UniformRandomReadBenchmark||GaussianRandomReadBenchmark||SequentialReadBenchmark|| |none|0.08113392|0.427078891|0.200721996|0.200015265|0.31840796 |gz|0.142759094|0.139561707|0.042473498|0.057292159|0.064873418 We can see Commons CRYPTO compared with JCE, it shows 4%~42% gain. > Improve transparent table/CF encryption with Commons Crypto > ----------------------------------------------------------- > > Key: HBASE-16463 > URL: https://issues.apache.org/jira/browse/HBASE-16463 > Project: HBase > Issue Type: New Feature > Components: encryption > Affects Versions: 2.0.0 > Reporter: Dapeng Sun > Attachments: HBASE-16463.001.patch, HBASE-16463.002.patch > > > Apache Commons Crypto (https://commons.apache.org/proper/commons-crypto/index.html) is a cryptographic library optimized with AES-NI. > HBASE-7544 introduces a framework for transparent encryption feature for protecting HFile and WAL data at rest. Currently JCE cipher is used bu default, the improvement will use Commons Crypto to accelerate the transparent encryption of HBase. new crypto provider with Commons CRYPTO will be provided for Transparent encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)