Return-Path: X-Original-To: apmail-horn-dev-archive@minotaur.apache.org Delivered-To: apmail-horn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A4680194C1 for ; Mon, 11 Apr 2016 08:26:29 +0000 (UTC) Received: (qmail 70998 invoked by uid 500); 11 Apr 2016 08:26:29 -0000 Delivered-To: apmail-horn-dev-archive@horn.apache.org Received: (qmail 70959 invoked by uid 500); 11 Apr 2016 08:26:29 -0000 Mailing-List: contact dev-help@horn.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@horn.incubator.apache.org Delivered-To: mailing list dev@horn.incubator.apache.org Received: (qmail 70948 invoked by uid 99); 11 Apr 2016 08:26:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Apr 2016 08:26:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 053FD1A08DA for ; Mon, 11 Apr 2016 08:26:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -3.221 X-Spam-Level: X-Spam-Status: No, score=-3.221 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001] autolearn=disabled Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id QjUw-AeZjcha for ; Mon, 11 Apr 2016 08:26:27 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with SMTP id D501E5F46E for ; Mon, 11 Apr 2016 08:26:26 +0000 (UTC) Received: (qmail 70408 invoked by uid 99); 11 Apr 2016 08:26:26 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 Apr 2016 08:26:26 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id ED69CDFE5F; Mon, 11 Apr 2016 08:26:25 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: edwardyoon@apache.org To: dev@horn.incubator.apache.org Message-Id: <3f5773a373b04fd19c9b896193c0522e@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: incubator-horn git commit: Remove some comparison info. Date: Mon, 11 Apr 2016 08:26:25 +0000 (UTC) Repository: incubator-horn Updated Branches: refs/heads/master 9d3bf25d3 -> 4069d8686 Remove some comparison info. Because, it's not a facts based on enough experiments. Project: http://git-wip-us.apache.org/repos/asf/incubator-horn/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-horn/commit/4069d868 Tree: http://git-wip-us.apache.org/repos/asf/incubator-horn/tree/4069d868 Diff: http://git-wip-us.apache.org/repos/asf/incubator-horn/diff/4069d868 Branch: refs/heads/master Commit: 4069d868615566baac26a24f38432c16af03affa Parents: 9d3bf25 Author: Edward J. Yoon Authored: Mon Apr 11 17:25:19 2016 +0900 Committer: Edward J. Yoon Committed: Mon Apr 11 17:25:19 2016 +0900 ---------------------------------------------------------------------- README.md | 14 -------------- 1 file changed, 14 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-horn/blob/4069d868/README.md ---------------------------------------------------------------------- diff --git a/README.md b/README.md index fd3ca9b..060dc8c 100644 --- a/README.md +++ b/README.md @@ -2,20 +2,6 @@ The Apache Horn is an Apache Incubating project, a neuron-centric programming model and Sync and Async hybrid distributed training framework, supports both data and model parallelism for training large models with massive datasets. Unlike most systems having matrix approach to neural network training, Horn adopted the the neuron-centric model which enables training large-scale deep learning on highly scalable CPU cluster. In the future, we plan also to support GPU accelerations for heterogeneous devices. -## Tensor vs. Neuron - -While tensor-based models would require an large memory consumption or parallel computational complexity to calibrate a large number of model parameters, the neuron-centric model has advantages like below: - - * More intuitive programming APIs - * An effective partition and parallelization strategy for large model - * Easy to understand how groups of neurons communicate - -| | Tensor | Neuron | -| ------------- |:-------------:|:-----:| -| Computation model | tensor/matrix-based computation model | neuron-based iterative computation model | -| Partitioning models | Vector or Submatrix (block) | Subgraph components (densely connected areas) | -| Communication overhead | Large | Small | - ## High Scalability The Apache Horn is an Sync and Async hybrid distributed training framework. Within single BSP job, each task group works asynchronously using region barrier synchronization instead of global barrier synchronization, and trains large-scale neural network model using assigned data sets in synchronous way.