hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From su...@apache.org
Subject [19/50] [abbrv] hadoop git commit: HADOOP-13978. Update project release notes for 3.0.0-alpha2. Contributed by Andrew Wang and Arun Suresh.
Date Tue, 17 Jan 2017 23:29:29 GMT
HADOOP-13978. Update project release notes for 3.0.0-alpha2. Contributed by Andrew Wang and
Arun Suresh.


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/37468ebf
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/37468ebf
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/37468ebf

Branch: refs/heads/YARN-2915
Commit: 37468ebf6f424d2a4bd654c589c00894e5376575
Parents: 706d630
Author: Andrew Wang <wang@apache.org>
Authored: Tue Jan 17 13:56:06 2017 -0800
Committer: Andrew Wang <wang@apache.org>
Committed: Tue Jan 17 13:56:06 2017 -0800

----------------------------------------------------------------------
 hadoop-project/src/site/markdown/index.md.vm | 40 +++++++++++++++++++++--
 1 file changed, 37 insertions(+), 3 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hadoop/blob/37468ebf/hadoop-project/src/site/markdown/index.md.vm
----------------------------------------------------------------------
diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm
index 8c766b4..62e21b2 100644
--- a/hadoop-project/src/site/markdown/index.md.vm
+++ b/hadoop-project/src/site/markdown/index.md.vm
@@ -88,6 +88,40 @@ documentation. Power users will also be pleased by the
 documentation, which describes much of the new functionality, particularly
 related to extensibility.
 
+Shaded client jars
+------------------
+
+The `hadoop-client` Maven artifact available in 2.x releases pulls
+Hadoop's transitive dependencies onto a Hadoop application's classpath.
+This can be problematic if the versions of these transitive dependencies
+conflict with the versions used by the application.
+
+[HADOOP-11804](https://issues.apache.org/jira/browse/HADOOP-11804) adds
+new `hadoop-client-api` and `hadoop-client-runtime` artifacts that
+shade Hadoop's dependencies into a single jar. This avoids leaking
+Hadoop's dependencies onto the application's classpath.
+
+Support for Opportunistic Containers and Distributed Scheduling.
+--------------------
+
+A notion of `ExecutionType` has been introduced, whereby Applications can
+now request for containers with an execution type of `Opportunistic`.
+Containers of this type can be dispatched for execution at an NM even if
+there are no resources available at the moment of scheduling. In such a
+case, these containers will be queued at the NM, waiting for resources to
+be available for it to start. Opportunistic containers are of lower priority
+than the default `Guaranteed` containers and are therefore preempted,
+if needed, to make room for Guaranteed containers. This should
+improve cluster utilization.
+
+Opportunistic containers are by default allocated by the central RM, but
+support has also been added to allow opportunistic containers to be
+allocated by a distributed scheduler which is implemented as an
+AMRMProtocol interceptor.
+
+Please see [documentation](./hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html)
+for more details.
+
 MapReduce task-level native optimization
 --------------------
 
@@ -132,11 +166,11 @@ notes for [HDFS-9427](https://issues.apache.org/jira/browse/HDFS-9427)
and
 [HADOOP-12811](https://issues.apache.org/jira/browse/HADOOP-12811)
 for a list of port changes.
 
-Support for Microsoft Azure Data Lake filesystem connector
+Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectors
 ---------------------
 
-Hadoop now supports integration with Microsoft Azure Data Lake as
-an alternative Hadoop-compatible filesystem.
+Hadoop now supports integration with Microsoft Azure Data Lake and
+Aliyun Object Storage System as alternative Hadoop-compatible filesystems.
 
 Intra-datanode balancer
 -------------------


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


Mime
View raw message