hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mori Bellamy <mbell...@apple.com>
Subject hadoop map reduce: additional heap space?
Date Fri, 27 Jun 2008 23:26:14 GMT
hey all,
i was wondering if theres a way to allocate more heap space for each  
mapper and reducer process that hadoop spawns. i'm getting this error:

java.lang.OutOfMemoryError: Java heap space
	at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:95)
	at java.io.DataOutputStream.write(DataOutputStream.java:90)
	at java.io.DataOutputStream.writeUTF(DataOutputStream.java:384)
	at java.io.DataOutputStream.writeUTF(DataOutputStream.java:306)

(i've written a custom class to use as the key/value pairs)

does anybody know how to allocate more heap space?? thanks!

View raw message