Return-Path: Delivered-To: apmail-incubator-hama-dev-archive@locus.apache.org Received: (qmail 59886 invoked from network); 21 Oct 2008 02:03:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 21 Oct 2008 02:03:45 -0000 Received: (qmail 83494 invoked by uid 500); 21 Oct 2008 02:03:47 -0000 Delivered-To: apmail-incubator-hama-dev-archive@incubator.apache.org Received: (qmail 83474 invoked by uid 500); 21 Oct 2008 02:03:47 -0000 Mailing-List: contact hama-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-dev@incubator.apache.org Delivered-To: mailing list hama-dev@incubator.apache.org Received: (qmail 83463 invoked by uid 99); 21 Oct 2008 02:03:47 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Oct 2008 19:03:47 -0700 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of guosijie@gmail.com designates 209.85.128.187 as permitted sender) Received: from [209.85.128.187] (HELO fk-out-0910.google.com) (209.85.128.187) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Oct 2008 02:02:33 +0000 Received: by fk-out-0910.google.com with SMTP id 19so2452579fkr.12 for ; Mon, 20 Oct 2008 19:03:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type:references; bh=Jxccgort5+6W4n3fxv42W1NRR+1z7ok562I6c0KQVbY=; b=gzxPoqYUq+KWYQXX7u7TQaGNCMbShxplDwOMG3Bo9lxTvUvoGKdcijFyIDFeIOdaPD 76yzgNLQehBvT7jw6lKFsZyWCalhRuolWufi3CM4LDqMN17xgvRzCgiIC6M6XuwiWok7 szN4Cq69WAUgbZNEjdypkCU4M7QaFMpd0okwo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:references; b=B2EdgfZjnPSYMOjA9G3q6JGNbTgdVWq66XLlGzNV7f6FNH1DvImbgtOYGmld4o8rPm EuDi4svCFeC7A4aIZGk4/+AV1xNS3b6H0jEd2f3QElosGREmOq/g4yu/aW6uhz3DyF3z VEKf9NyaSx8tIXGx2vI+uXy2rWldgurWNfR1c= Received: by 10.187.213.16 with SMTP id p16mr1229425faq.73.1224554590963; Mon, 20 Oct 2008 19:03:10 -0700 (PDT) Received: by 10.187.179.3 with HTTP; Mon, 20 Oct 2008 19:03:10 -0700 (PDT) Message-ID: <25aacb800810201903n3bff1221kc0e17de2ca4dc259@mail.gmail.com> Date: Tue, 21 Oct 2008 10:03:10 +0800 From: "Samuel Guo" To: hama-dev@incubator.apache.org Subject: Re: 2D blocking algorithm In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_282_9657609.1224554590942" References: <25aacb800810201818k3573a0bdtf76da95dcc73871e@mail.gmail.com> X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_282_9657609.1224554590942 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline hmm, your explanation is clear. but if we store the matrix to file, the block layout is fixed. Is this block layout efficient in every matrix operation? How to choose the block size to make the parallel computation efficient? On Tue, Oct 21, 2008 at 9:36 AM, Edward J. Yoon wrote: > For example, > We have a 4 * 4 Matrix a : > > [a, b, c, d] > [e, f, g, h] > [i, j, k, l] > [m, n, o, p]] > > Then, we can store an 2 * 2 block matrices to file. > > block(0, 0) is a 2 * 2 sub-matrix as below. > > [a, b] > [e, f] > > Key : block(0, 0), Value : submatrix [a, b], [e, f] > Key : block(0, 1), Value : submatrix [c, d], [g, h] > Key : block(1, 0), Value : submatrix [i, j], [m, n] > Key : block(1, 1), Value : submatrix [k, l], [o, p] > > ..... > > Also, If we can access sub-matrix from Hbase table, blocking can be > pre-computed. > > On Tue, Oct 21, 2008 at 10:18 AM, Samuel Guo wrote: > > should the matrices that do the multiplication have the same blockID > layout? > > > > And How to divide a matrix into BlockIDs to make the parallel computation > > most efficiently? > > > > 2008/10/21 Edward J. Yoon > > > >> Can anyone review this ?? > >> > >> http://blog.udanax.org/2008/10/parallel-matrix-multiply-on-hadoop.html > >> > >> -- > >> Best regards, Edward J. Yoon > >> edwardyoon@apache.org > >> http://blog.udanax.org > >> > > > > > > -- > Best regards, Edward J. Yoon > edwardyoon@apache.org > http://blog.udanax.org > ------=_Part_282_9657609.1224554590942--