aurora-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ma...@apache.org
Subject aurora git commit: Adding oversubscription summary.
Date Mon, 21 Sep 2015 22:37:02 GMT
Repository: aurora
Updated Branches:
  refs/heads/master 9d780262d -> 88a6f249e


Adding oversubscription summary.

Bugs closed: AURORA-1441

Reviewed at https://reviews.apache.org/r/38390/


Project: http://git-wip-us.apache.org/repos/asf/aurora/repo
Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/88a6f249
Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/88a6f249
Diff: http://git-wip-us.apache.org/repos/asf/aurora/diff/88a6f249

Branch: refs/heads/master
Commit: 88a6f249e31c31392cabf19c8691be1fd1c40cbb
Parents: 9d78026
Author: Maxim Khutornenko <maxim@apache.org>
Authored: Mon Sep 21 15:36:46 2015 -0700
Committer: Maxim Khutornenko <maxim@apache.org>
Committed: Mon Sep 21 15:36:46 2015 -0700

----------------------------------------------------------------------
 docs/configuration-reference.md    | 17 +++++++++++++++++
 docs/deploying-aurora-scheduler.md | 16 ++++++++++++++++
 2 files changed, 33 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/configuration-reference.md
----------------------------------------------------------------------
diff --git a/docs/configuration-reference.md b/docs/configuration-reference.md
index ad2701c..8d50c45 100644
--- a/docs/configuration-reference.md
+++ b/docs/configuration-reference.md
@@ -26,6 +26,7 @@ Aurora + Thermos Configuration Reference
 - [Job Schema](#job-schema)
     - [Job Objects](#job-objects)
     - [Services](#services)
+    - [Revocable Jobs](#revocable-jobs)
     - [UpdateConfig Objects](#updateconfig-objects)
     - [HealthCheckConfig Objects](#healthcheckconfig-objects)
     - [Announcer Objects](#announcer-objects)
@@ -328,6 +329,7 @@ Job Schema
   ```health_check_config``` | ```heath_check_config``` object | Parameters for controlling
a task's health checks via HTTP. Only used if a  health port was assigned with a command line
wildcard.
   ```container``` | ```Container``` object | An optional container to run all processes inside
of.
   ```lifecycle``` | ```LifecycleConfig``` object | An optional task lifecycle configuration
that dictates commands to be executed on startup/teardown.  HTTP lifecycle is enabled by default
if the "health" port is requested.  See [LifecycleConfig Objects](#lifecycleconfig-objects)
for more information.
+  ```tier``` | String | Task tier type. When set to `revocable` requires the task to run
with Mesos revocable resources. This is work [in progress](https://issues.apache.org/jira/browse/AURORA-1343)
and is currently only supported for the revocable tasks. The ultimate goal is to simplify
task configuration by hiding various configuration knobs behind a task tier definition. See
AURORA-1343 and AURORA-1443 for more details.
 
 ### Services
 
@@ -339,6 +341,21 @@ Jobs without the service bit set only restart up to
 `max_task_failures` times and only if they terminated unsuccessfully
 either due to human error or machine failure.
 
+### Revocable Jobs
+
+**WARNING**: This feature is currently in alpha status. Do not use it in production clusters!
+
+Mesos [supports a concept of revocable tasks](http://mesos.apache.org/documentation/latest/oversubscription/)
+by oversubscribing machine resources by the amount deemed safe to not affect the existing
+non-revocable tasks. Aurora now supports revocable jobs via a `tier` setting set to `revocable`
+value.
+
+More implementation details in this [ticket](https://issues.apache.org/jira/browse/AURORA-1343).
+
+Scheduler must be [configured](deploying-aurora-scheduler.md#configuring-resource-oversubscription)
+to receive revocable offers from Mesos and accept revocable jobs. If not configured properly
+revocable tasks will never get assigned to hosts and will stay in PENDING.
+
 ### UpdateConfig Objects
 
 Parameters for controlling the rate and policy of rolling updates.

http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/deploying-aurora-scheduler.md
----------------------------------------------------------------------
diff --git a/docs/deploying-aurora-scheduler.md b/docs/deploying-aurora-scheduler.md
index 8db0e61..2a46d2f 100644
--- a/docs/deploying-aurora-scheduler.md
+++ b/docs/deploying-aurora-scheduler.md
@@ -14,6 +14,7 @@ machines.  This guide helps you get the scheduler set up and troubleshoot
some c
   - [Network considerations](#network-considerations)
   - [Considerations for running jobs in docker](#considerations-for-running-jobs-in-docker)
   - [Security Considerations](#security-considerations)
+  - [Configuring Resource Oversubscription](#configuring-resource-oversubscription)
 - [Running Aurora](#running-aurora)
   - [Maintaining an Aurora Installation](#maintaining-an-aurora-installation)
   - [Monitoring](#monitoring)
@@ -190,6 +191,21 @@ assuming you set `-http_port=8081`.
 
 See [security.md](security.md).
 
+## Configuring Resource Oversubscription
+
+**WARNING**: This feature is currently in alpha status. Do not use it in production clusters!
+See [this document](configuration-reference.md#revocable-jobs) for more feature details.
+
+Set these scheduler flag to allow receiving revocable Mesos offers:
+
+    -receive_revocable_resources=true
+
+Specify a tier configuration file path:
+
+    -tier_config=path/to/tiers/config.json
+
+Example [tier configuration file](../src/test/resources/org/apache/aurora/scheduler/tiers-example.json).
+
 ### Maintaining an Aurora Installation
 
 ### Monitoring


Mime
View raw message