zookeeper-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ZOOKEEPER-3437) Improve sync throttling on a learner master
Date Fri, 26 Jul 2019 03:52:00 GMT

    [ https://issues.apache.org/jira/browse/ZOOKEEPER-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893297#comment-16893297
] 

Hudson commented on ZOOKEEPER-3437:
-----------------------------------

SUCCESS: Integrated in Jenkins build ZooKeeper-trunk #629 (See [https://builds.apache.org/job/ZooKeeper-trunk/629/])
ZOOKEEPER-3437: Improve sync throttling on a learner master (eolivelli: rev f38905e58e4961ae04d876e1855d6ccb372a706b)
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LearnerHandler.java
* (add) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LearnerSyncThrottler.java
* (add) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/SyncThrottleException.java
* (edit) zookeeper-docs/src/main/resources/markdown/zookeeperAdmin.md
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/FollowerBean.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LeaderMXBean.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LeaderBean.java
* (delete) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LearnerSnapshotThrottler.java
* (delete) zookeeper-server/src/test/java/org/apache/zookeeper/server/quorum/LearnerSnapshotThrottlerTest.java
* (edit) zookeeper-server/src/test/java/org/apache/zookeeper/server/quorum/QuorumPeerMainTest.java
* (delete) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/SnapshotThrottleException.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/Leader.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LearnerMaster.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/ObserverMaster.java
* (add) zookeeper-server/src/test/java/org/apache/zookeeper/server/quorum/LearnerSyncThrottlerTest.java
* (edit) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/FollowerMXBean.java
* (delete) zookeeper-server/src/main/java/org/apache/zookeeper/server/quorum/LearnerSnapshot.java


> Improve sync throttling on a learner master
> -------------------------------------------
>
>                 Key: ZOOKEEPER-3437
>                 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3437
>             Project: ZooKeeper
>          Issue Type: Improvement
>          Components: quorum
>    Affects Versions: 3.6.0
>            Reporter: Jie Huang
>            Assignee: Jie Huang
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 3.6.0
>
>          Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> As described in ZOOKEEPER-1928, a leader can become overloaded if it sends too many
snapshots concurrently during sync time.  Sending too many diffs at the same time can also
cause the overloading issue. 
> In this JIRA, we will:
>  # add diff sync throttling in addition to snap sync throttling
>  # extend the protection to followers that serve observers
>  # improve the counting of concurrent snap syncs/diff syncs to avoid double counting
or missing counting



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Mime
View raw message