hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Duo Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions
Date Wed, 01 Nov 2017 13:03:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234041#comment-16234041

Duo Zhang commented on HBASE-16417:

+1 on commit to branch-2. Just go ahead. I think in memory compaction is a very important
feature for 2.0.0.


> In-Memory MemStore Policy for Flattening and Compactions
> --------------------------------------------------------
>                 Key: HBASE-16417
>                 URL: https://issues.apache.org/jira/browse/HBASE-16417
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Anastasia Braginsky
>            Assignee: Eshcar Hillel
>            Priority: Major
>             Fix For: 3.0.0
>         Attachments: HBASE-16417 - Adaptive Compaction Policy - 20171001.pdf, HBASE-16417
- parameter tuning - 20171001.pdf, HBASE-16417-V01.patch, HBASE-16417-benchmarkresults-20161101.pdf,
HBASE-16417-benchmarkresults-20161110.pdf, HBASE-16417-benchmarkresults-20161123.pdf, HBASE-16417-benchmarkresults-20161205.pdf,
HBASE-16417-benchmarkresults-20170309.pdf, HBASE-16417-benchmarkresults-20170317.pdf, HBASE-16417.01.patch,
HBASE-16417.02.patch, HBASE-16417.03.patch, HBASE-16417.04.patch, HBASE-16417.05.patch, HBASE-16417.06.patch,
HBASE-16417.07.patch, HBASE-16417.07.patch, HBASE-16417.08.patch, HBASE-16417.09.patch, HBASE-16417.10.patch,
HBASE-16417.11.patch, HBASE-16417.12.patch, HBASE-16417.13.patch, HBASE-16417.14.patch, HBASE-16417.15.patch,
HBASE-16417.16.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch,
HBASE-16417.17.patch, HBASE-16417.18.patch, HBASE-16417.branch-2.17.patch
> This Jira explores the performance of different memstore compaction policies.
> It presents the result of write-only workload evaluation as well as read performance
in read-write workloads.
> We investigate several settings of hardware (SSD, HDD), key distribution (Zipf, uniform),
with multiple settings of the system, and compare measures like write throughput, read latency,
write volume, total gc time, etc.
> The submitted patch sets some system properties at the values yielding optimal performance.
In addition we suggest a new Adaptive memstore compaction policy that shows good tradeoffs
between write throughput and write volume.

This message was sent by Atlassian JIRA

View raw message