accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mike Drob" <md...@mdrob.com>
Subject Re: Review Request 19862: Design document for review on cross-cluster replication
Date Wed, 02 Apr 2014 15:57:53 GMT


> On April 2, 2014, 3:36 p.m., Mike Drob wrote:
> >

Huh, RB proxy error ate my comment.

I was speaking to some of the HBase team about this yesterday, and they mentioned that they
do not support replicated bulk import. Their recommended solution is just to externally copy
files and run bulk import on the slave. Since this is something that is possible for users
to configure themselves, I'd like to make sure we focus on the difficult case of like ingest.

Is the assumption that replication is an all-or-nothing deal? Either you replicate all of
the tables on a system, or you replicate none of them, but just a defined set is not allowed?
I believe the WAL groups mutations by table IDs, so care would need to be taken to make sure
those do not get out of sync.

What happens when I clone a table, for example when running an offline MR job. does the clone
need to be replicated? I assume no. If the slave is a read-only implementation, can I make
clones there to run MR? Maybe another thing that will come out of this is 'transient clones'
that have IDs in a reserved high range that can be reused after they are deleted.


- Mike


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19862/#review39264
-----------------------------------------------------------


On April 1, 2014, 1:58 a.m., Josh Elser wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19862/
> -----------------------------------------------------------
> 
> (Updated April 1, 2014, 1:58 a.m.)
> 
> 
> Review request for accumulo.
> 
> 
> Bugs: ACCUMULO-378
>     https://issues.apache.org/jira/browse/ACCUMULO-378
> 
> 
> Repository: accumulo
> 
> 
> Description
> -------
> 
> Re-posting a version of the design doc that I own. Contains grammatical fixes from round
one, with a few extra clarifications. New content should be posted here, but I'll maintain
the old review as discussion progresses.
> 
> 
> Diffs
> -----
> 
>   docs/src/main/resources/design/ACCUMULO-378-design.mdtext PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/19862/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Josh Elser
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message