incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject Share my experience
Date Wed, 14 Jan 2009 12:49:47 GMT
Lately, I investigate a lot of traditional methods of parallel
processing and experiment some high level processing (e.g. matrix
algebra, graph algorithm) using Hadoop/Hbase/MapReduce.

The only way to increase speed linearly was locality (Do write all
data even if there are duplicated efforts). Increased node numbers,
there is a linear increase of IO channel.

Network communication is not a solution.

-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message