hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Li Li <fancye...@gmail.com>
Subject hadoop cluster crash problem
Date Wed, 17 Sep 2014 02:25:11 GMT
hi all,
    I know it's not a problem related to hadoop but administrator can
not find any clues.
    I have a machine with 24 core and 64GB memory with ubuntu 12.04
LTS. we use virtual box to create 4 virtual machine. Each vm has 10GB
memory and 6 core.
    I have setup a small hadoop 1.2.1 cluster with one
jobtracker/namenode and 3 tasktracker/datanode. Each tasktrack has 4
mapper slots and 4 reducers slot.
    But it always crashs(the host machine crash, not vm crash).
Sometimes it crashes for the first map-reduce job. Sometimes it can
run a few jobs.
    is there any clues? I have checked the sys log and can find any
thing useful. Using monitor system, The cpu and io is not abnormal.
The only abnormal phenomenon is context switch is high. about 40k.

View raw message