Return-Path: X-Original-To: apmail-accumulo-commits-archive@www.apache.org Delivered-To: apmail-accumulo-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A6A05175CE for ; Fri, 7 Nov 2014 21:01:24 +0000 (UTC) Received: (qmail 24770 invoked by uid 500); 7 Nov 2014 21:01:24 -0000 Delivered-To: apmail-accumulo-commits-archive@accumulo.apache.org Received: (qmail 24662 invoked by uid 500); 7 Nov 2014 21:01:24 -0000 Mailing-List: contact commits-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list commits@accumulo.apache.org Received: (qmail 24646 invoked by uid 99); 7 Nov 2014 21:01:24 -0000 Received: from tyr.zones.apache.org (HELO tyr.zones.apache.org) (140.211.11.114) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Nov 2014 21:01:24 +0000 Received: by tyr.zones.apache.org (Postfix, from userid 65534) id 389BD99D9EE; Fri, 7 Nov 2014 21:01:24 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: elserj@apache.org To: commits@accumulo.apache.org Date: Fri, 07 Nov 2014 21:01:24 -0000 Message-Id: <0f66adae999e43e3a639db8914f43251@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [1/2] accumulo git commit: ACCUMULO-3231 Add a readme Repository: accumulo Updated Branches: refs/heads/master 5fdbb8191 -> 5aff1fb7b ACCUMULO-3231 Add a readme Project: http://git-wip-us.apache.org/repos/asf/accumulo/repo Commit: http://git-wip-us.apache.org/repos/asf/accumulo/commit/5aff1fb7 Tree: http://git-wip-us.apache.org/repos/asf/accumulo/tree/5aff1fb7 Diff: http://git-wip-us.apache.org/repos/asf/accumulo/diff/5aff1fb7 Branch: refs/heads/master Commit: 5aff1fb7bbac4fbcaf37121125e076f120c1e50e Parents: f6af58d Author: Josh Elser Authored: Fri Nov 7 15:49:41 2014 -0500 Committer: Josh Elser Committed: Fri Nov 7 15:51:53 2014 -0500 ---------------------------------------------------------------------- test/system/merkle-replication/README | 65 ++++++++++++++++++++++++++++++ 1 file changed, 65 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/accumulo/blob/5aff1fb7/test/system/merkle-replication/README ---------------------------------------------------------------------- diff --git a/test/system/merkle-replication/README b/test/system/merkle-replication/README new file mode 100644 index 0000000..18100de --- /dev/null +++ b/test/system/merkle-replication/README @@ -0,0 +1,65 @@ + + +Distributed Replication Test +=========================== + +Ingests random data into a table configured for replication, and then +verifies that the original table and the replicated table have equivalent +data using a Merkle tree. + +* Steps to run test + +1. Configure merkle-env.sh + + Be sure to set the username/password to connect to Accumulo and + the Accumulo instance name and ZooKeepers. The example defaults + to using the same instance as the source and destination. + + The randomness of the generated data can be controlled via some + parameters in this file. Note that if deletes are introduced, it + is very likely to cause an incorrect verification since the tombstone'ing + of that delete will differ on the source and remote due to the order + of minor compactions that occur. + +2. Run configure-replication.sh + + This script sets up the two instances for replication, creates + the tables that will be replicated and adds some splits to them. + + This is destructive to any existing replication configuration so + use it with care on a real instance. + +3. Run ingest-data.sh + + Ingests the configured amount of random data into the source + table. + +4. Run stop-all.sh && start-all.sh on the source instance + + A tabletserver in the source instance is likely to still be referencing + a WAL for a presently online tablet which will prevent that + file from being replicated. Stopping the local instance will ensure + that all WALs are candidate for replication. + +5. Run verify-data.sh + + This will compute the leaves merkle tree for the source and destination + tables and then compute the root hash for both. The root hash + is presented to the user. + + If the root hashes are equal, the test passed; otherwise, the test fails.