hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peng, Wei" <Wei.P...@xerox.com>
Subject RE: breadth-first search
Date Wed, 22 Dec 2010 16:57:55 GMT
Can someone tell me whether we can run multiple threads in hadoop?

Thanks
Wei

-----Original Message-----
From: Peng, Wei [mailto:Wei.Peng@xerox.com] 
Sent: Tuesday, December 21, 2010 9:07 PM
To: common-user@hadoop.apache.org
Subject: RE: breadth-first search

I was just trying to run 100 source nodes in multiple threads, but the
mapreduce tasks still look like to run in sequential.
Do I need to configure hadoop somehow for multiple threads? Assign more
task slots? How?


Thanks

-----Original Message-----
From: Ted Dunning [mailto:tdunning@maprtech.com] 
Sent: Tuesday, December 21, 2010 1:10 PM
To: common-user@hadoop.apache.org
Subject: Re: breadth-first search

Absolutely true.  Nobody should pretend otherwise.

On Tue, Dec 21, 2010 at 10:04 AM, Peng, Wei <Wei.Peng@xerox.com> wrote:

> Hadoop is useful when the data is huge and cannot fit into memory, but
it
> does not seem to be a real-time solution.

Mime
View raw message