hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joris Poort <gpo...@gmail.com>
Subject Hadoop java mapper -copyFromLocal heap size error
Date Sat, 24 Sep 2011 00:20:07 GMT
As part of my Java mapper I have a command executes some code on the
local node and copies a local output file to the hadoop fs.
Unfortunately I'm getting the following output:

    "Error occurred during initialization of VM"
    "Could not reserve enough space for object heap"

I've tried adjusting mapred.map.child.java.opts to -Xmx512M, but
unfortunately no luck.

When I ssh into the node, I can run the -copyFromLocal command without
any issues. The ouput files are also quite small like around 100kb.

Any help would be greatly appreciated!



View raw message