hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andre Kelpe <ake...@concurrentinc.com>
Subject Re: hadoop cluster crash problem
Date Wed, 17 Sep 2014 11:03:30 GMT
virtualbox is known for causing instabilities in the host-kernel (or at
least, it used to). You might be better off asking for support there:

- André

On Wed, Sep 17, 2014 at 4:25 AM, Li Li <fancyerii@gmail.com> wrote:

> hi all,
>     I know it's not a problem related to hadoop but administrator can
> not find any clues.
>     I have a machine with 24 core and 64GB memory with ubuntu 12.04
> LTS. we use virtual box to create 4 virtual machine. Each vm has 10GB
> memory and 6 core.
>     I have setup a small hadoop 1.2.1 cluster with one
> jobtracker/namenode and 3 tasktracker/datanode. Each tasktrack has 4
> mapper slots and 4 reducers slot.
>     But it always crashs(the host machine crash, not vm crash).
> Sometimes it crashes for the first map-reduce job. Sometimes it can
> run a few jobs.
>     is there any clues? I have checked the sys log and can find any
> thing useful. Using monitor system, The cpu and io is not abnormal.
> The only abnormal phenomenon is context switch is high. about 40k.

André Kelpe

View raw message