Return-Path: X-Original-To: apmail-horn-dev-archive@minotaur.apache.org Delivered-To: apmail-horn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E075C175FD for ; Tue, 17 Nov 2015 09:47:37 +0000 (UTC) Received: (qmail 26794 invoked by uid 500); 17 Nov 2015 09:47:37 -0000 Delivered-To: apmail-horn-dev-archive@horn.apache.org Received: (qmail 26745 invoked by uid 500); 17 Nov 2015 09:47:37 -0000 Mailing-List: contact dev-help@horn.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@horn.incubator.apache.org Delivered-To: mailing list dev@horn.incubator.apache.org Received: (qmail 26734 invoked by uid 99); 17 Nov 2015 09:47:37 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Nov 2015 09:47:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 372211A0A25 for ; Tue, 17 Nov 2015 09:47:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.771 X-Spam-Level: * X-Spam-Status: No, score=1.771 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, T_RP_MATCHES_RCVD=-0.01, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id B1VdZRf3SPN0 for ; Tue, 17 Nov 2015 09:47:36 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id 4979A21249 for ; Tue, 17 Nov 2015 09:47:35 +0000 (UTC) Received: (qmail 26725 invoked by uid 99); 17 Nov 2015 09:47:34 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Nov 2015 09:47:34 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 38610DFE2E; Tue, 17 Nov 2015 09:47:34 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: edwardyoon@apache.org To: dev@horn.incubator.apache.org Message-Id: <686a3519c84b47609ce163f295f03c86@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: incubator-horn git commit: Update readme directly Date: Tue, 17 Nov 2015 09:47:34 +0000 (UTC) Repository: incubator-horn Updated Branches: refs/heads/master 3d06e5de8 -> c10b6f67d Update readme directly Project: http://git-wip-us.apache.org/repos/asf/incubator-horn/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-horn/commit/c10b6f67 Tree: http://git-wip-us.apache.org/repos/asf/incubator-horn/tree/c10b6f67 Diff: http://git-wip-us.apache.org/repos/asf/incubator-horn/diff/c10b6f67 Branch: refs/heads/master Commit: c10b6f67dc9bd2e4c67cfa32e38f05ebb9a91469 Parents: 3d06e5d Author: Edward J. Yoon Authored: Tue Nov 17 18:47:19 2015 +0900 Committer: Edward J. Yoon Committed: Tue Nov 17 18:47:19 2015 +0900 ---------------------------------------------------------------------- README.md | 21 ++++++++++++++++++++- 1 file changed, 20 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-horn/blob/c10b6f67/README.md ---------------------------------------------------------------------- diff --git a/README.md b/README.md index c155637..fd3ca9b 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,26 @@ # Apache Horn -Apache Horn is a neuron-centric programming model and execution framework, inspired by Google's DistBelief, supports both data and model parallelism for training large models with massive datasets, currently in Incubator status. +The Apache Horn is an Apache Incubating project, a neuron-centric programming model and Sync and Async hybrid distributed training framework, supports both data and model parallelism for training large models with massive datasets. Unlike most systems having matrix approach to neural network training, Horn adopted the the neuron-centric model which enables training large-scale deep learning on highly scalable CPU cluster. In the future, we plan also to support GPU accelerations for heterogeneous devices. + +## Tensor vs. Neuron + +While tensor-based models would require an large memory consumption or parallel computational complexity to calibrate a large number of model parameters, the neuron-centric model has advantages like below: + + * More intuitive programming APIs + * An effective partition and parallelization strategy for large model + * Easy to understand how groups of neurons communicate + +| | Tensor | Neuron | +| ------------- |:-------------:|:-----:| +| Computation model | tensor/matrix-based computation model | neuron-based iterative computation model | +| Partitioning models | Vector or Submatrix (block) | Subgraph components (densely connected areas) | +| Communication overhead | Large | Small | + +## High Scalability + +The Apache Horn is an Sync and Async hybrid distributed training framework. Within single BSP job, each task group works asynchronously using region barrier synchronization instead of global barrier synchronization, and trains large-scale neural network model using assigned data sets in synchronous way. ## Getting Involved Horn is an open source volunteer project under the Apache Software Foundation. We encourage you to learn about the project and contribute your expertise. +