pinot-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [incubator-pinot] Jackie-Jiang opened a new pull request #5046: Re-design the broker routing
Date Mon, 03 Feb 2020 23:09:09 GMT
Jackie-Jiang opened a new pull request #5046: Re-design the broker routing
URL: https://github.com/apache/incubator-pinot/pull/5046
 
 
   Motivation:
   - De-couple the partition pruning from the replica-group routing
   - Support real-time replica-group routing
   - Handle the scenario of external view not matching instance partitions
   - Reduce the number of ZK accesses when processing cluster changes
   - Support segment refresh for routing purposr (time boundary info & partitioning info)
   - Support routing rebuild without restarting broker
   
   Added RoutingManager as the instance level entry of the routing with the following methods:
   - buildRouting()
   - removeRouting()
   - refreshSegment()
   - routingExists()
   - getRoutingTable()
   - getTimeBoundaryInfo()
   
   Break the routing table calculation into 3 steps:
   - Segment selection
   - Segment pruning
   - Instance selection
   
   This PR includes the implementation and tests
   Will plug the new broker routing in the following PR

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


Mime
View raw message