hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher Smith <cbsm...@gmail.com>
Subject Re: measure the resource usage of each map/reduce task
Date Tue, 01 Mar 2011 17:44:11 GMT
Actually, that is configurable. Multiple tasks can be run from the
same JVM, and you can also use the MultithreadedMapper
(http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapreduce/lib/map/MultithreadedMapper.html)
to at least make map tasks run in the same thread.

On Tue, Mar 1, 2011 at 9:09 AM, Harsh J <qwertymaniac@gmail.com> wrote:
> Hello,
>
> On Tue, Mar 1, 2011 at 7:29 PM, bikash sharma <sharmabiks.07@gmail.com> wrote:
>> Hi,
>> As a follow-up question, do map/reduce tasks run as threads or processes?
>
> Every launched Task runs as an independent process, communicating over
> a network interface (lo) with the TaskTracker for reporting/etc.
> purposes.
>
> --
> Harsh J
> www.harshj.com
>



-- 
Chris

Mime
View raw message