asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Murtadha Hubail (Code Review)" <do-not-re...@asterixdb.incubator.apache.org>
Subject Change in asterixdb[master]: [ASTERIXDB-2081][STO] Introduce DatasetMemoryManager
Date Mon, 30 Oct 2017 20:17:43 GMT
Hello Jenkins,

I'd like you to reexamine a change.  Please visit

    https://asterix-gerrit.ics.uci.edu/2112

to look at the new patch set (#3).

Change subject: [ASTERIXDB-2081][STO] Introduce DatasetMemoryManager
......................................................................

[ASTERIXDB-2081][STO] Introduce DatasetMemoryManager

- user model changes: no
- storage format changes: no
- interface changes: yes
  Added IDatasetMemoryManager to manage datasets memory
  reservation and allocation.

Details:
- Reserve metadata datasets memory to allow them to be opened
  when needed.
- Close all datasets at the end of recovery to clear
  used memory and flush all recovered datasets.
- Add UngracefulShutdownNCApplication to force recovery
  to run on AsterixHyracksIntegrationUtil.
- Refactor the use of firstAvilableUserDatasetID to check
  for metadata datasets.
- Add ThreadSafe annotation.
- Add test case for RecoveryManager after creating multiple
  datasets.

Change-Id: Ica76b3c8eca6f7d2ad1d962fb5ef84267c258571
---
M asterixdb/asterix-app/src/main/java/org/apache/asterix/api/common/AsterixHyracksIntegrationUtil.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/NCAppRuntimeContext.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/nc/RecoveryManager.java
A asterixdb/asterix-app/src/test/java/org/apache/asterix/test/txn/RecoveryManagerTest.java
A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/IDatasetMemoryManager.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/api/INcApplicationContext.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetLifecycleManager.java
A asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetMemoryManager.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetResource.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/context/DatasetVirtualBufferCaches.java
M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/metadata/MetadataIndexImmutableProperties.java
A asterixdb/asterix-common/src/test/java/org/apache/asterix/test/context/DatasetMemoryManagerTest.java
M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/bootstrap/MetadataBootstrap.java
A hyracks-fullstack/hyracks/hyracks-util/src/main/java/org/apache/hyracks/util/annotations/ThreadSafe.java
14 files changed, 563 insertions(+), 65 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/12/2112/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/2112
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ica76b3c8eca6f7d2ad1d962fb5ef84267c258571
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: Murtadha Hubail <mhubail@apache.org>
Gerrit-Reviewer: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Mime
View raw message