hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions
Date Wed, 01 Nov 2017 22:24:02 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234852#comment-16234852
] 

Hudson commented on HBASE-16417:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-2.0 #782 (See [https://builds.apache.org/job/HBase-2.0/782/])
HBASE-16417: In-memory MemStore Policy for Flattening and Compactions (eshcar: rev 526d2826f5cce4f3b21326657d3c17a651aa6975)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CellArrayImmutableSegment.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CellChunkImmutableSegment.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/VersionedSegmentsList.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/MemoryCompactionPolicy.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRecoveredEdits.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/BasicMemStoreCompactionStrategy.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SegmentFactory.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ImmutableSegment.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactor.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/AdaptiveMemStoreCompactionStrategy.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/EagerMemStoreCompactionStrategy.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHStore.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactingMemStore.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestWalAndCompactingMemStoreFlush.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CellSet.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingMemStore.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/ClassSize.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactionPipeline.java
* (add) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactionStrategy.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingToCellFlatMapMemStore.java


> In-Memory MemStore Policy for Flattening and Compactions
> --------------------------------------------------------
>
>                 Key: HBASE-16417
>                 URL: https://issues.apache.org/jira/browse/HBASE-16417
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Anastasia Braginsky
>            Assignee: Eshcar Hillel
>            Priority: Major
>             Fix For: 3.0.0
>
>         Attachments: HBASE-16417 - Adaptive Compaction Policy - 20171001.pdf, HBASE-16417
- parameter tuning - 20171001.pdf, HBASE-16417-V01.patch, HBASE-16417-benchmarkresults-20161101.pdf,
HBASE-16417-benchmarkresults-20161110.pdf, HBASE-16417-benchmarkresults-20161123.pdf, HBASE-16417-benchmarkresults-20161205.pdf,
HBASE-16417-benchmarkresults-20170309.pdf, HBASE-16417-benchmarkresults-20170317.pdf, HBASE-16417.01.patch,
HBASE-16417.02.patch, HBASE-16417.03.patch, HBASE-16417.04.patch, HBASE-16417.05.patch, HBASE-16417.06.patch,
HBASE-16417.07.patch, HBASE-16417.07.patch, HBASE-16417.08.patch, HBASE-16417.09.patch, HBASE-16417.10.patch,
HBASE-16417.11.patch, HBASE-16417.12.patch, HBASE-16417.13.patch, HBASE-16417.14.patch, HBASE-16417.15.patch,
HBASE-16417.16.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch, HBASE-16417.17.patch,
HBASE-16417.17.patch, HBASE-16417.18.patch, HBASE-16417.branch-2.17.patch
>
>
> This Jira explores the performance of different memstore compaction policies.
> It presents the result of write-only workload evaluation as well as read performance
in read-write workloads.
> We investigate several settings of hardware (SSD, HDD), key distribution (Zipf, uniform),
with multiple settings of the system, and compare measures like write throughput, read latency,
write volume, total gc time, etc.
> The submitted patch sets some system properties at the values yielding optimal performance.
In addition we suggest a new Adaptive memstore compaction policy that shows good tradeoffs
between write throughput and write volume.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message