accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser" <josh.el...@gmail.com>
Subject Re: Review Request 24855: ACCUMULO-1454 design doc
Date Tue, 19 Aug 2014 18:31:02 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24855/#review51006
-----------------------------------------------------------


One big design concern I have is what gains the final solution would actually have over what
is currently possible with Accumulo as it stands.

Right now, you can force tablets to migrate by stopping a tserver. This goes back through
the balancer, so you have a bit of churn in however many "rounds" the Balancer takes to choose
where those tablets should go, and then for the master to process the necessary assignments
for each tserver. How I'm seeing it described is that the only piece of the puzzle that we're
making better is removing the migration components in favor of letting the user control this
directly. How much does a "smart" Balancer implementation close the gap between the user providing
migrations in regards to performance? Also, how does removing the Balancer from the equation
change the wall time to get a tablet assigned (is it significant)?

We have to also understand that while we can decompose the problem into some simple primitives,
I believe this approach is still a rather difficult distributed state problem that I'm worried
is being over-architected. My $0.02.

- Josh Elser


On Aug. 19, 2014, 5:50 p.m., kturner wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/24855/
> -----------------------------------------------------------
> 
> (Updated Aug. 19, 2014, 5:50 p.m.)
> 
> 
> Review request for accumulo.
> 
> 
> Bugs: ACCUMULO-1454
>     https://issues.apache.org/jira/browse/ACCUMULO-1454
> 
> 
> Repository: accumulo
> 
> 
> Description
> -------
> 
> Positing ACCUMULO-1454 design doc for review
> 
> 
> Diffs
> -----
> 
>   docs/src/main/asciidoc/design/ACCUMULO-1454-proposal-01.adoc PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/24855/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> kturner
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message