asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luo Chen (Code Review)" <do-not-re...@asterixdb.incubator.apache.org>
Subject Change in asterixdb[master]: Implemented LSM disk components alignment for datasets using...
Date Fri, 05 May 2017 02:36:40 GMT
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

    https://asterix-gerrit.ics.uci.edu/1725

to look at the new patch set (#4).

Change subject: Implemented LSM disk components alignment for datasets using CorrelatedPrefixMergePolicy.
The basic idea is to always flush/merge all indexes of a correlated dataset together into
a group. Design doc:https://cwiki.apache.org/confluence/display/ASTERIXDB/L
......................................................................

Implemented LSM disk components alignment for datasets using CorrelatedPrefixMergePolicy.
The basic idea is to always flush/merge all indexes of a correlated dataset together into
a group.
Design doc:https://cwiki.apache.org/confluence/display/ASTERIXDB/LSM+Component+Alignment+Design+Doc

The following commits from your working branch will be included:

commit a52aa36053fae966ab8246aefee2f5d98f484350
Author: luochen01 <cluo8@uci.edu>
Date:   Wed May 3 17:36:32 2017 -0700

    fix compilation error

commit 6e2cbe84db715da2cd039f721456d56414c15847
Author: luochen01 <cluo8@uci.edu>
Date:   Wed May 3 12:10:17 2017 -0700

    clean up error messages

commit 997bb839229f43bcbfab6d946e8aaa6e024c31db
Author: luochen01 <cluo8@uci.edu>
Date:   Wed May 3 11:33:32 2017 -0700

    Prepare to commit.

commit 0235ac99b9459b2ab845d1dd819cc8a102192414
Author: Till Westmann <tillw@apache.org>
Date:   Sat Apr 29 15:56:32 2017 -0700

    Add support for binary test results

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1710
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Till Westmann <tillw@apache.org>

commit f1bda46e5588d4b950f4ca231345a7bda651f6f4
Author: Abdullah Alamoudi <bamousaa@gmail.com>
Date:   Sat Apr 29 07:03:57 2017 +0300

    Make Index Op Contexts fields private

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1712
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

commit 0d051192b8bab1f5f69b6eb5673d038216d13588
Author: Michael Blow <mblow@apache.org>
Date:   Fri Apr 28 19:24:18 2017 -0400

    Remove Unused / Historical Hyracks Modules

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1714
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Ian Maxon <imaxon@apache.org>

commit 5451aa9f28be0ac080f9fb341d3c799814a3308e
Author: Michael Blow <mblow@apache.org>
Date:   Fri Apr 28 17:08:45 2017 -0400

    Ensure Proper Process is Killed With Managix Stop

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1707
    Reviewed-by: Ian Maxon <imaxon@apache.org>
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

commit ad424448a387f1b893ca73a0790d16dbd2b09651
Author: Michael Blow <mblow@apache.org>
Date:   Thu Apr 27 16:56:39 2017 -0400

    Cleanup Logging, Report Joined Nodes, Misc Cleanup

    - Minor refactoring of NodeControllerService startup
    - Cleanup logging in GlobalRecoveryManager / LifeCycleComponentManager
    - Enable TestExecutor to accept non-200 status codes
    - Use ExecutorService for GlobalRecovery thread
    - Eliminate NPE when metadata node goes down before global recovery
      starts

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1706
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Till Westmann <tillw@apache.org>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

commit 013426cd4ec934623d1e27fd44ba1e63b8aae0a7
Author: Till Westmann <tillw@apache.org>
Date:   Tue Apr 25 23:17:04 2017 -0700

    Document the Query Service API

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1698
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Till Westmann <tillw@apache.org>
    Reviewed-by: Michael Carey <dtabass@gmail.com>

commit 5f4a743e55449cc0f1c0a48e3e8afd24dbe761cc
Author: Xikui Wang <xkkwww@gmail.com>
Date:   Tue Apr 25 13:31:16 2017 -0700

    Fix NULL/MISSING field value handing in Java UDF

    Add NULL/MISSING value support in Java UDF. This fixed the NPE when there
    is a NULL/MISSING field in a record.

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1695
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

commit 37dba5e4d45ce3c86e7a797e0b1bcb101231e4b2
Author: Till Westmann <tillw@apache.org>
Date:   Mon Apr 24 13:43:38 2017 -0700

    Remove IOMVisitor and its only (unused) implementation

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1699
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

commit 5449e85ab32d51d88e29b1f50d8450d1bd7a05bd
Author: Taewoo Kim <wangsaeu@yahoo.com>
Date:   Sun Apr 23 17:29:52 2017 -0700

    Index-Only Plan Patch Set 4: Index SearchCursor adjustment

     - Modify the search cursors to maintain the result of proceed()
       since the result will be required to check whether the given tuple
       is qualified to be part of an index-only plan result or not.
       More details will be followed in the next patch set.
     - Fix the search cursors to call cancel() correctly.

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1630
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

commit 53ee561c1d10db8d612240df2ac4bb3478925cfe
Author: Yingyi Bu <yingyi@couchbase.com>
Date:   Mon Apr 24 16:39:42 2017 -0700

    Enable debug option in Ansible/AWS scripts.

    When the debug option is set to be true, for each NCDriver process:
    - a debugger port is open;
    - a Yourkit agent is attached and a Yourkit remote port is open.

    Add -Xmx for NCDriver if the user-provided jvm.args does not contain it.

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1700
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Ian Maxon <imaxon@apache.org>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

commit 9018655123bd4f65402fbdf18598a884c43cfeb2
Author: AsterixDB Jenkins <dev@asterixdb.apache.org>
Date:   Thu Apr 13 15:00:24 2017 -0700

    Advance version to AsterixDB 0.9.2-SNAPSHOT and Hyracks 0.3.2-SNAPSHOT

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1680
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Ian Maxon <imaxon@apache.org>

commit 9a32bcdeb233bd68e8a29f24fee9f19b4e0aebc2
Author: AsterixDB Jenkins <dev@asterixdb.apache.org>
Date:   Thu Apr 13 15:00:06 2017 -0700

    Release Apache AsterixDB 0.9.1 and 0.3.1

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1679
    Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Ian Maxon <imaxon@apache.org>

commit 88fa68667a1215aabed39b998c98af933a8971db
Author: Abdullah Alamoudi <bamousaa@gmail.com>
Date:   Fri Apr 21 04:50:06 2017 +0300

    Remove static cc application context instance

    Reviewed-on: https://asterix-gerrit.ics.uci.edu/1606
    Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
    Reviewed-by: Michael Blow <mblow@apache.org>

commit 41f34e3a7af2ac72be8164273ba046a7e79c6dd7
Author: luochen01 <cluo8@uci.edu>
Date:   Wed Apr 12 09:28:45 2017 -0700

    temporary commit for merge

Change-Id: I64bf34e255def72adc73b9f87cfa628a172ea694
---
A asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.1.ddl.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.2.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.3.update.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.4.query.aql
A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.1.ddl.sqlpp
A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.2.update.sqlpp
A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.3.update.sqlpp
A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.4.query.sqlpp
A asterixdb/asterix-app/src/test/resources/runtimets/results/dml/using-correlated-prefix-merge-policy-with-feed/using-correlated-prefix-merge-policy-with-feed.1.adm
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/CorrelatedPrefixMergePolicy.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetInfo.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetLifecycleManager.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/PrimaryIndexOperationTracker.java
A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/ioopcallbacks/LSMIOOperationGroupCallback.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/ExternalBTreeWithBuddy.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTree.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreeFlushOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreeMergeOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-btree/src/main/java/org/apache/hyracks/storage/am/lsm/btree/impls/LSMBTreeWithBuddyMergeOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMHarness.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIOOperation.java
A hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIOOperationGroup.java
A hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIOOperationGroupCallback.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIOOperationScheduler.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIndex.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMIndexAccessor.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/api/ILSMMergePolicy.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/AbstractLSMIndex.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/AsynchronousScheduler.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/LSMHarness.java
A hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/LSMIOOperationGroup.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/LSMTreeIndexAccessor.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-common/src/main/java/org/apache/hyracks/storage/am/lsm/common/impls/SynchronousScheduler.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndex.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndexAccessor.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndexFlushOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/org/apache/hyracks/storage/am/lsm/invertedindex/impls/LSMInvertedIndexMergeOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-rtree/src/main/java/org/apache/hyracks/storage/am/lsm/rtree/impls/LSMRTree.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-rtree/src/main/java/org/apache/hyracks/storage/am/lsm/rtree/impls/LSMRTreeFlushOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-rtree/src/main/java/org/apache/hyracks/storage/am/lsm/rtree/impls/LSMRTreeMergeOperation.java
M hyracks-fullstack/hyracks/hyracks-storage-am-lsm-rtree/src/main/java/org/apache/hyracks/storage/am/lsm/rtree/impls/LSMRTreeWithAntiMatterTuples.java
A hyracks-fullstack/hyracks/hyracks-tests/hyracks-storage-am-lsm-common-test/src/test/java/org/apache/hyracks/storage/am/lsm/common/DummyOperationGroup.java
A hyracks-fullstack/hyracks/hyracks-tests/hyracks-storage-am-lsm-common-test/src/test/java/org/apache/hyracks/storage/am/lsm/common/SchedulerTest.java
43 files changed, 2,011 insertions(+), 169 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/25/1725/4
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/1725
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I64bf34e255def72adc73b9f87cfa628a172ea694
Gerrit-PatchSet: 4
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Luo Chen <cluo8@uci.edu>
Gerrit-Reviewer: Ian Maxon <imaxon@apache.org>
Gerrit-Reviewer: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Jianfeng Jia <jianfeng.jia@gmail.com>
Gerrit-Reviewer: Yingyi Bu <buyingyi@gmail.com>
Gerrit-Reviewer: abdullah alamoudi <bamousaa@gmail.com>

Mime
View raw message