Return-Path: X-Original-To: apmail-myriad-commits-archive@minotaur.apache.org Delivered-To: apmail-myriad-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6348F18FF1 for ; Fri, 20 Nov 2015 06:00:23 +0000 (UTC) Received: (qmail 77331 invoked by uid 500); 20 Nov 2015 06:00:23 -0000 Delivered-To: apmail-myriad-commits-archive@myriad.apache.org Received: (qmail 77302 invoked by uid 500); 20 Nov 2015 06:00:23 -0000 Mailing-List: contact commits-help@myriad.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@myriad.incubator.apache.org Delivered-To: mailing list commits@myriad.incubator.apache.org Received: (qmail 77293 invoked by uid 99); 20 Nov 2015 06:00:23 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Nov 2015 06:00:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id CBE251A075B for ; Fri, 20 Nov 2015 06:00:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.791 X-Spam-Level: * X-Spam-Status: No, score=1.791 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id sdULKItYew8z for ; Fri, 20 Nov 2015 06:00:07 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id 9415B2311F for ; Fri, 20 Nov 2015 06:00:06 +0000 (UTC) Received: (qmail 75676 invoked by uid 99); 20 Nov 2015 06:00:05 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Nov 2015 06:00:05 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 7BB4EDFAF5; Fri, 20 Nov 2015 06:00:05 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: smarella@apache.org To: commits@myriad.incubator.apache.org Date: Fri, 20 Nov 2015 06:00:06 -0000 Message-Id: <59b594640fc44514841f0763dc7e6a02@git.apache.org> In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [2/2] incubator-myriad git commit: Incorporated feedback from IPMC on RC2 Incorporated feedback from IPMC on RC2 - Added build instructions to generate a "gradlew" script when building Myriad from source downloads. Myriad's source releases will henceforth exclude the "gradlew" script and the "gradle-wrapper.jar". - Modified the LICENSE file to match the stock LICENSE. Added a note that normalize.css is MIT licensed. - Updated the top level README to include an explicit section for build instructions. It just points to the "developing myriad" document so that users don't struggle to find out where the build instructions are located. This closes: #49 Review: https://github.com/apache/incubator-myriad/pull/49 Project: http://git-wip-us.apache.org/repos/asf/incubator-myriad/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-myriad/commit/c914c373 Tree: http://git-wip-us.apache.org/repos/asf/incubator-myriad/tree/c914c373 Diff: http://git-wip-us.apache.org/repos/asf/incubator-myriad/diff/c914c373 Branch: refs/heads/master Commit: c914c37334a6baf6aecd96710a0331c53227d614 Parents: 5d268fa Author: smarella Authored: Thu Nov 19 21:52:37 2015 -0800 Committer: smarella Committed: Thu Nov 19 21:52:37 2015 -0800 ---------------------------------------------------------------------- LICENSE | 8 +++++- README.md | 8 +++--- docs/myriad-dev.md | 70 +++++++++++++++++++++++++++++-------------------- 3 files changed, 53 insertions(+), 33 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/c914c373/LICENSE ---------------------------------------------------------------------- diff --git a/LICENSE b/LICENSE index 44e1680..2bad5c2 100644 --- a/LICENSE +++ b/LICENSE @@ -187,7 +187,7 @@ same "printed page" as the copyright notice for easier identification within third-party archives. - Copyright 2012-present Apache Software Foundation + Copyright [yyyy] [name of copyright owner] Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. @@ -210,4 +210,10 @@ notices and license terms. Your use of the source code for the these subcomponents is subject to the terms and conditions of the following licenses. +============================================================================== +For normalize.css +============================================================================== +bootstrap-myriad.css bundles normalize.css which is available under a +"MIT" license. For details, see +https://github.com/necolas/normalize.css/blob/3.0.2/LICENSE.md http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/c914c373/README.md ---------------------------------------------------------------------- diff --git a/README.md b/README.md index d5e6650..02925ae 100644 --- a/README.md +++ b/README.md @@ -10,9 +10,6 @@ The name _Myriad_ means, _countless or extremely great number_. In context of th ## Getting started -For up-to-date documentation, see [Apache Myriad](https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home) on the wiki. - - * [How Myriad works](docs/how-it-works.md) * [Developing Myriad](docs/myriad-dev.md) * [Local vagrant setup guide](docs/vagrant.md) @@ -23,6 +20,11 @@ For up-to-date documentation, see [Apache Myriad](https://cwiki.apache.org/confl * [Deploying the Myriad Resource-Manger using Docker](docker/README.md) * [Mesos, YARN and cgroups](docs/cgroups.md) +For up-to-date documentation, see [Apache Myriad](https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home) on the wiki. + +## Build Myriad +Please refer to the [build](docs/myriad-dev.md#step-1-build-myriad) section for steps to build Myriad. + ## Roadmap Please keep checking this section for updates. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/c914c373/docs/myriad-dev.md ---------------------------------------------------------------------- diff --git a/docs/myriad-dev.md b/docs/myriad-dev.md index 0c18a0c..fd600c1 100644 --- a/docs/myriad-dev.md +++ b/docs/myriad-dev.md @@ -1,62 +1,63 @@ # Installing for Developers -## Setting up Editor Support +## Step 1: Build Myriad -You are welcome to use any editor you like, however, many of the myriad developers use IntelliJ IDEA. The build process described below uses [gradle](https://gradle.org/). The build script is configured with the [idea plugin](https://docs.gradle.org/current/userguide/idea_plugin.html) to create an intellij project structure. This is accomplished with the following command: +### Requirements + - Linux/Unix/Mac OS X + - JDK 7 + - [gradle](http://gradle.org) + - **Gradle installation is required to build Myriad from a source release download** + - If building Myriad from the project's git clone, gradle installation is *not required* -``` -./gradlew idea +### Installing the gradle wrapper +> These instructions apply to source release downloads only. +> If Myriad sources are checked out from the [git repository](https://github.com/apache/incubator-myriad), the gradle wrapper script will already be available. -# to open on a mac -open myriad.ipr -``` +Myriad's source release tarball does not include gradle wrapper script. So you'll need to: -**NOTE:** If you are interested in using eclipse, there is a plugin for that. Either send in a pull request, or send a message on the dev mail list that you would make use of it. +- Install gradle: + - Please follow the instructions on [gradle's website](http://gradle.org) to install gradle. We tested Myriad with gradle 2.9. +- Generate the gradle wrapper script: + - Once gradle is installed, execute ```gradle wrapper``` command from the $PROJECT_ROOT of the Myriad project. This generates a ```$PROJECT_ROOT/gradlew``` script, and also places a supporting jar at ```$PROJECT_ROOT/gradle/wrapper/gradle-wrapper.jar```. -## Step 1: Build Myriad - To build Myriad (both Myriad Scheduler and Executor), from the $PROJECT_HOME, run: +### Building the binaries + + Ensure ```$PROJECT_ROOT/gradlew``` script is available. Run the following command from $PROJECT_ROOT to build Myriad (both Scheduler and Executor components): ``` ./gradlew build ``` -At this point the jars are located in the following directories (relative to $PROJECT_HOME). - +At this point the jars will be located in the following directories: ``` # scheduler jars -./myriad-scheduler/build/libs/ +$PROJECT_HOME/myriad-scheduler/build/libs/ # executor jar -./myriad-executor/build/libs/ - +$PROJECT_HOME/myriad-executor/build/libs/ ``` ### Building Myriad Scheduler Only -Before building Myriad Scheduler, modify [myriad-config-default.yml](../myriad-scheduler/src/main/resources/myriad-config-default.yml) with the appropriate configuration properties. The build process`.gradlew build` command builds the myriad-x.x.x.jar file, download the runtime jars, and places them inside the **./build/libs/** directory (relative to the $PROJECT_HOME/myriad-scheduler directory). -To build Myriad Scheduler, from $PROJECT_HOME/myriad-scheduler run: +To build only the Scheduler, from $PROJECT_HOME, run: ```bash -./gradlew build +./gradlew :myriad-scheduler:build ``` - ### Building Myriad Executor Only -The `./gradlew build` command builds the **myriad-executor-runnable-xxx.jar** and place it inside the **$PROJECT_HOME/myriad-executor/build/libs/** directory. - -To build Myriad Executor individually as a self-contained executor jar, from $PROJECT_HOME/myriad-executor, run: +To build only the Executor, from $PROJECT_HOME, run: ```bash -./gradlew build +./gradlew :myriad-executor:build ``` +## Step 2: Deploy the Myriad Binaries -## Step 2: Deploy the Myriad Files +To deploy Myriad Scheduler and Executor Binaries: -To deploy Myriad Scheduler and Executor files: - -1. Copy the Myriad Scheduler jar files from the $PROJECT_HOME/myriad-scheduler/build/libs/ directory to the $YARN_HOME/share/hadoop/yarn/lib/ directory on all nodes in your cluster. +1. Copy the Myriad Scheduler jar and it's dependencies from the $PROJECT_HOME/myriad-scheduler/build/libs/ directory to the $YARN_HOME/share/hadoop/yarn/lib/ directory on all nodes in your cluster. 2. Copy the Myriad Executor myriad-executor-xxx.jar file from the $PROJECT_HOME/myriad-executor/build/libs/ directory to each mesos slave's $YARN_HOME/share/hadoop/yarn/lib/ directory. 3. Copy the myriad-config-default.yml file from $PROJECT_HOME/myriad-scheduler/build/src/main/resources/ directory to the $YARN_HOME/etc/hadoop directory. @@ -147,7 +148,6 @@ export MESOS_NATIVE_JAVA_LIBRARY=/usr/local/lib/libmesos.so ``` - ## Starting the Resource Manager Myriad Scheduler runs inside Resource Manager as a plugin. To start the Resource Manager: @@ -155,10 +155,22 @@ Myriad Scheduler runs inside Resource Manager as a plugin. To start the Resource ./sbin/yarn-daemon.sh start resourcemanager ``` - ## Running Myriad Executor and Node Managers Myriad Executor and Node Managers are launched automatically by Myriad Scheduler as a response to flexup and flex down behavior. See the [Myriad Cluster API](API.md). +## Setting up Editor/IDE Support + +You are welcome to use any editor you like, however, many of the myriad developers use IntelliJ IDEA. The build process described below uses [gradle](https://gradle.org/). The build script is configured with the [idea plugin](https://docs.gradle.org/current/userguide/idea_plugin.html) to create an intellij project structure. This is accomplished with the following command: + +``` +./gradlew idea + +# to open on a mac +open myriad.ipr +``` + +**NOTE:** If you are interested in using eclipse, there is a plugin for that. Either send in a pull request, or send a message on the [dev mail list](dev@myriad.incubator.apache.org) that you would make use of it. + --- Licensed to the Apache Software Foundation (ASF) under one