asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Murtadha Hubail (Code Review)" <do-not-re...@asterixdb.incubator.apache.org>
Subject Change in asterixdb[master]: [ASTERIXDB-2263][RT] Use Plan Stages To Estimate Resources
Date Thu, 25 Jan 2018 01:43:30 GMT
Hello Anon. E. Moose #1000171, Jenkins,

I'd like you to reexamine a change.  Please visit

    https://asterix-gerrit.ics.uci.edu/2299

to look at the new patch set (#3).

Change subject: [ASTERIXDB-2263][RT] Use Plan Stages To Estimate Resources
......................................................................

[ASTERIXDB-2263][RT] Use Plan Stages To Estimate Resources

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Introduce PlanStagesGenerator that generates
  plan stages using blocking/two-phased operators.
- Introduce OperatorResourcesComputer that
  calculates the estimated resources for any
  logical operator.
- Estimate jobs required resources based on
  the stage that requires most resources in
  the plan.
- The current algorithm used to generate stages
  does not consider Replicate/Split operators
  as blocking operators. This could results
  in over estimation since multiple stages
  might be combined as a single stage.

Change-Id: Ic715c5733621e27049677f44e1ddaa0dd2c71baf
---
A asterixdb/asterix-app/src/main/java/org/apache/asterix/app/resource/OperatorResourcesComputer.java
A asterixdb/asterix-app/src/main/java/org/apache/asterix/app/resource/PlanStage.java
A asterixdb/asterix-app/src/main/java/org/apache/asterix/app/resource/PlanStagesGenerator.java
M asterixdb/asterix-app/src/main/java/org/apache/asterix/utils/ResourceUtils.java
A asterixdb/asterix-app/src/test/java/org/apache/asterix/app/resource/PlanStagesGeneratorTest.java
5 files changed, 869 insertions(+), 12 deletions(-)


  git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/99/2299/3
-- 
To view, visit https://asterix-gerrit.ics.uci.edu/2299
To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings

Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ic715c5733621e27049677f44e1ddaa0dd2c71baf
Gerrit-PatchSet: 3
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Owner: shivaj@uci.edu
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Murtadha Hubail <mhubail@apache.org>

Mime
View raw message