Return-Path: X-Original-To: apmail-asterixdb-notifications-archive@minotaur.apache.org Delivered-To: apmail-asterixdb-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4DF1A18712 for ; Sat, 9 Jan 2016 05:11:02 +0000 (UTC) Received: (qmail 10967 invoked by uid 500); 9 Jan 2016 05:11:02 -0000 Delivered-To: apmail-asterixdb-notifications-archive@asterixdb.apache.org Received: (qmail 10936 invoked by uid 500); 9 Jan 2016 05:11:02 -0000 Mailing-List: contact notifications-help@asterixdb.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.incubator.apache.org Delivered-To: mailing list notifications@asterixdb.incubator.apache.org Received: (qmail 10927 invoked by uid 99); 9 Jan 2016 05:11:02 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 09 Jan 2016 05:11:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 86C68180476 for ; Sat, 9 Jan 2016 05:11:01 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.92 X-Spam-Level: X-Spam-Status: No, score=0.92 tagged_above=-999 required=6.31 tests=[SPF_FAIL=0.919, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 6ON2A24ZzF23 for ; Sat, 9 Jan 2016 05:10:49 +0000 (UTC) Received: from unhygienix.ics.uci.edu (unhygienix.ics.uci.edu [128.195.14.130]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTP id BF37020511 for ; Sat, 9 Jan 2016 05:10:48 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by unhygienix.ics.uci.edu (Postfix) with ESMTP id A0EA52418DF; Fri, 8 Jan 2016 21:06:56 -0800 (PST) Date: Fri, 8 Jan 2016 21:06:56 -0800 From: "Murtadha Hubail (Code Review)" To: Jenkins CC: abdullah alamoudi , Ian Maxon , Till Westmann Reply-To: hubailmor@gmail.com X-Gerrit-MessageType: newpatchset Subject: Change in asterixdb[master]: Asterix NCs Fault Tolerance X-Gerrit-Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4 X-Gerrit-ChangeURL: X-Gerrit-Commit: 9871b3ba59088ce4889eddb7e56d42b56381f9fc In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Content-Disposition: inline User-Agent: Gerrit/2.8.4 Message-Id: <20160109050656.A0EA52418DF@unhygienix.ics.uci.edu> Hello Jenkins, I'd like you to reexamine a change. Please visit https://asterix-gerrit.ics.uci.edu/573 to look at the new patch set (#2). Change subject: Asterix NCs Fault Tolerance ...................................................................... Asterix NCs Fault Tolerance This change includes the following: - Adapt replication to unique partitions storage. - Implement auto failover for failing NCs. - Implement auto failover for metadata node. - Fix for ASTERIXDB-1251 using proper error message. - Basic replication test cases using vagrant virtual cluster for: 1. LSM bulkload components replication. 2. LSM Memory components replication and recovery. 3. Metadata node takeover. These test cases will be part of the cluster test profile. Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4 --- M asterix-app/src/main/java/org/apache/asterix/api/common/AsterixAppRuntimeContext.java M asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/CCApplicationEntryPoint.java M asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/ClusterLifecycleListener.java R asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/GlobalRecoveryManager.java M asterix-app/src/main/java/org/apache/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java M asterix-app/src/main/java/org/apache/asterix/messaging/CCMessageBroker.java M asterix-app/src/main/java/org/apache/asterix/messaging/NCMessageBroker.java M asterix-common/src/main/java/org/apache/asterix/common/api/IAsterixAppRuntimeContext.java A asterix-common/src/main/java/org/apache/asterix/common/cluster/IGlobalRecoveryMaanger.java M asterix-common/src/main/java/org/apache/asterix/common/config/AsterixMetadataProperties.java M asterix-common/src/main/java/org/apache/asterix/common/config/AsterixReplicationProperties.java M asterix-common/src/main/java/org/apache/asterix/common/dataflow/IAsterixApplicationContextInfo.java A asterix-common/src/main/java/org/apache/asterix/common/messaging/TakeoverMetadataNodeRequestMessage.java A asterix-common/src/main/java/org/apache/asterix/common/messaging/TakeoverMetadataNodeResponseMessage.java A asterix-common/src/main/java/org/apache/asterix/common/messaging/TakeoverPartitionsRequestMessage.java A asterix-common/src/main/java/org/apache/asterix/common/messaging/TakeoverPartitionsResponseMessage.java M asterix-common/src/main/java/org/apache/asterix/common/messaging/api/IApplicationMessage.java A asterix-common/src/main/java/org/apache/asterix/common/messaging/api/ICCMessageBroker.java M asterix-common/src/main/java/org/apache/asterix/common/replication/IRemoteRecoveryManager.java M asterix-common/src/main/java/org/apache/asterix/common/replication/IReplicaResourcesManager.java M asterix-common/src/main/java/org/apache/asterix/common/transactions/IRecoveryManager.java M asterix-common/src/main/resources/schema/cluster.xsd M asterix-common/src/test/java/org/apache/asterix/test/aql/TestExecutor.java M asterix-events/src/main/java/org/apache/asterix/event/util/PatternCreator.java M asterix-installer/pom.xml M asterix-installer/src/main/java/org/apache/asterix/installer/command/ValidateCommand.java A asterix-installer/src/test/java/org/apache/asterix/installer/test/ReplicationIT.java A asterix-installer/src/test/resources/clusterts/cluster_with_replication.xml M asterix-installer/src/test/resources/clusterts/known_hosts A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.1.ddl.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.2.update.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.3.txnqbc.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.4.vagrant_script.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.5.sleep.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/bulkload/bulkload.6.txnqar.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.1.ddl.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.2.update.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.3.txnqbc.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.4.vagrant_script.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.5.sleep.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/mem_component_recovery/mem_component_recovery.6.txnqar.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/metadata_node/metadata_node.1.ddl.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/metadata_node/metadata_node.2.txnqbc.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/metadata_node/metadata_node.3.vagrant_script.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/metadata_node/metadata_node.4.sleep.aql A asterix-installer/src/test/resources/integrationts/replication/queries/failover/metadata_node/metadata_node.5.txnqar.aql A asterix-installer/src/test/resources/integrationts/replication/testsuite.xml M asterix-metadata/src/main/java/org/apache/asterix/metadata/bootstrap/MetadataBootstrap.java M asterix-metadata/src/main/java/org/apache/asterix/metadata/utils/SplitsAndConstraintsUtil.java M asterix-om/src/main/java/org/apache/asterix/om/util/AsterixAppContextInfo.java M asterix-om/src/main/java/org/apache/asterix/om/util/AsterixClusterProperties.java M asterix-replication/src/main/java/org/apache/asterix/replication/functions/AsterixReplicationProtocol.java M asterix-replication/src/main/java/org/apache/asterix/replication/management/ReplicationChannel.java M asterix-replication/src/main/java/org/apache/asterix/replication/management/ReplicationManager.java M asterix-replication/src/main/java/org/apache/asterix/replication/recovery/RemoteRecoveryManager.java D asterix-replication/src/main/java/org/apache/asterix/replication/storage/AsterixFilesUtil.java M asterix-replication/src/main/java/org/apache/asterix/replication/storage/LSMComponentProperties.java R asterix-replication/src/main/java/org/apache/asterix/replication/storage/LSMIndexFileProperties.java M asterix-replication/src/main/java/org/apache/asterix/replication/storage/ReplicaResourcesManager.java A asterix-replication/src/test/resources/data/fbu.adm A asterix-replication/src/test/resources/scripts/delete_storage.sh A asterix-replication/src/test/resources/scripts/kill_cc_and_nc.sh M asterix-transactions/src/main/java/org/apache/asterix/transaction/management/resource/PersistentLocalResourceRepository.java M asterix-transactions/src/main/java/org/apache/asterix/transaction/management/resource/PersistentLocalResourceRepositoryFactory.java M asterix-transactions/src/main/java/org/apache/asterix/transaction/management/service/recovery/RecoveryManager.java 65 files changed, 2,014 insertions(+), 579 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/73/573/2 -- To view, visit https://asterix-gerrit.ics.uci.edu/573 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4 Gerrit-PatchSet: 2 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Murtadha Hubail Gerrit-Reviewer: Ian Maxon Gerrit-Reviewer: Jenkins Gerrit-Reviewer: Till Westmann Gerrit-Reviewer: abdullah alamoudi