hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zhang jianfeng <zjf...@gmail.com>
Subject Re: Datanode high memory usage
Date Mon, 31 Aug 2009 15:40:12 GMT
I think what you see is reduce task, because in reduce task, you have three
steps:
copy , sort, and reudce.  The copy and  sort steps may cost a lot of memory.



2009/8/31 Stas Oskin <stas.oskin@gmail.com>

> Hi.
>
>
> > What does 700MB represent for ? total memory usage of OS or only the task
> > process.
> >
> >
> The Datanode task process - I'm running just it to find out how actually
> RAM
> it takes.
>
> Regards.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message