incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject blocking_mapred() speed
Date Thu, 11 Dec 2008 06:36:50 GMT
If we remove 'reduce phase', I guess we can reduce the disk I/O operations.

In the map, read { Constants.BLOCK_STARTROW, Constants.BLOCK_ENDROW,
Constants.BLOCK_STARTCOLUMN, Constants.BLOCK_ENDCOLUMN } instead of {
Constants.COLUMN }, and write directly blocks.

What do you think?

-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message