hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5699) Run with > 1 WAL in HRegionServer
Date Fri, 19 Dec 2014 00:23:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252622#comment-14252622

Sean Busbey commented on HBASE-5699:

I don't have any ideas for region grouping besides identity; I think it's a fine starting
point. The current configuration makes "multiwal" the bounded version, so there's only N configurable
wals (the current patch says 1, but 2 might make more sense). It doesn't given an option yet
for "wal per region", so anyone who wants to use that would have to manually specify the fully
qualified class name. If we wanted to give them assurances about compatibility we'd need to
give them a config name.

I'm split on wether it makes sense to make it the default given the modest improvement. I'm
inclined to leave the default alone for 1.0 and change it for later once we have some more
stats on e.g. impact on recovery. My intuition says wal recovery should be roughly the same.

> Run with > 1 WAL in HRegionServer
> ---------------------------------
>                 Key: HBASE-5699
>                 URL: https://issues.apache.org/jira/browse/HBASE-5699
>             Project: HBase
>          Issue Type: Improvement
>          Components: Performance, wal
>            Reporter: binlijin
>            Assignee: Sean Busbey
>            Priority: Critical
>         Attachments: HBASE-5699.3.patch.txt, HBASE-5699.4.patch.txt, HBASE-5699_#workers_vs_MiB_per_s_1x1col_512Bval_wal_count_1,2,4.tiff,
HBASE-5699_write_iops_multiwal-1_1_to_200_threads.tiff, HBASE-5699_write_iops_multiwal-2_10,50,120,190,260,330,400_threads.tiff,
HBASE-5699_write_iops_multiwal-4_10,50,120,190,260,330,400_threads.tiff, HBASE-5699_write_iops_multiwal-6_10,50,120,190,260,330,400_threads.tiff,
HBASE-5699_write_iops_upstream_1_to_200_threads.tiff, PerfHbase.txt, hbase-5699_multiwal_400-threads_stats_sync_heavy.txt,
hbase-5699_total_throughput_sync_heavy.txt, results-hbase5699-upstream.txt.bz2, results-hbase5699-wals-1.txt.bz2,
results-updated-hbase5699-wals-2.txt.bz2, results-updated-hbase5699-wals-4.txt.bz2, results-updated-hbase5699-wals-6.txt.bz2

This message was sent by Atlassian JIRA

View raw message