incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Edward J. Yoon" <edwardy...@apache.org>
Subject RetriesExhaustedException during HTable.commit
Date Thu, 11 Dec 2008 02:56:47 GMT
I am receiving the RetriesExhaustedException exception during
HTable.commit, the size of cell is 50 mb (2,500 * 2,500 double
entries).
Is there a configuration to avoid this problem?

Cluster : 4 node, 16 cores (Intel(R) Xeon(R) CPU 2.33GHz, SATA hard
disk, Physical Memory 16 GB)

Thanks.

----
08/12/11 11:40:58 INFO mapred.JobClient:  map 100% reduce 76%
08/12/11 11:41:02 INFO mapred.JobClient:  map 100% reduce 80%
08/12/11 11:42:07 INFO mapred.JobClient: Task Id :
attempt_200812100956_0044_r_000007_1, Status : FAILED
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 61.247.201.164:60020 for region
DenseMatrix_randmmnwo,,1228961537371, row '1', but failed after 10
attempts.
Exceptions:
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space

        at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:863)
        at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:964)
        at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:950)
        at org.apache.hama.DenseMatrix.setBlock(DenseMatrix.java:496)
        at org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(BlockingMapRed.java:150)
        at org.apache.hama.mapred.BlockingMapRed$BlockingReducer.reduce(BlockingMapRed.java:122)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
        at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)

-- 
Best Regards, Edward J. Yoon @ NHN, corp.
edwardyoon@apache.org
http://blog.udanax.org

Mime
View raw message