hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17432) Use less threads to read WAL in replication
Date Fri, 22 Sep 2017 19:58:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16177013#comment-16177013

Sean Busbey commented on HBASE-17432:

You think this is still going to land in time for 2.0 betas [~yangzhe1991]? Or want to put
it off for 2.1?

> Use less threads to read WAL in replication
> -------------------------------------------
>                 Key: HBASE-17432
>                 URL: https://issues.apache.org/jira/browse/HBASE-17432
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Phil Yang
>            Assignee: Phil Yang
>             Fix For: 2.0.0
> Now for each peer and each failover source we use different threads to read WAL, which
means one WAL file will be read many times if we have many peers. We can read logs in one
thread and push them to peers concurrently.
> Some cases should be considered. For example, if one of peers is stuck, the reading thread
should kick it out of concurrent peers and use an independent thread to read logs for this
peer just like old style. If finally this peer's progress catch up other peers, they can be
merged back.
> Of course, failover threads should still be independent because they read different WAL

This message was sent by Atlassian JIRA

View raw message