pulsar-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] sijie commented on issue #1886: Underreplicated ledgers did not refresh when bookie was recovered
Date Tue, 05 Jun 2018 22:50:25 GMT
sijie commented on issue #1886: Underreplicated ledgers did not refresh when bookie was recovered
URL: https://github.com/apache/incubator-pulsar/issues/1886#issuecomment-394884438
 
 
   @bardock 
   
   the replication workers checks the ledgers before actually replicating them. so if all
the bookies come back online, the replication workers should detect that and mark those ledgers
as replicated.
   
   I think the problem might come from this change in yahoo branch-4.3.
   
   https://github.com/yahoo/bookkeeper/blob/yahoo-4.3/bookkeeper-server/src/main/java/org/apache/bookkeeper/conf/ServerConfiguration.java#L1416
   
   it does 100% verification when attempts to replicating a ledger, which means it will read
all the entries, which consume the network bandwidth and cpu, and it prevents replication
worker mark ledgers as replicated.
   
   I would suggest setting `auditorLedgerVerificationPercentage` to 0 in the bookkeeper.conf
used by autorecovery. I believe that would address the issues you are seeing here (~~and maybe
#1625 as well~~)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message