hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From li ping <li.j...@gmail.com>
Subject Re: How to speed up of Map/Reduce job?
Date Tue, 01 Feb 2011 14:35:46 GMT
The Hadoop is designed for no-real time application.
But You can change the parameter to reduce the job execution time.

I search an article in Google.
Hope You can find some useful information on that.
http://www.slideshare.net/ImpetusInfo/ppt-on-advanced-hadoop-tuning-n-optimisation

On Tue, Feb 1, 2011 at 4:19 PM, Igor Bubkin <igba14@gmail.com> wrote:

> Hello everybody
>
> I have a problem. I installed Hadoop on 2-nodes cluster and run Wordcount
> example. It takes about 20 sec for processing of 1,5MB text file. We want
> to
> use Map/Reduce in real time (interactive: by user's requests). User can't
> wait for his request 20 sec. This is too long. Is it possible to reduce
> time
> of Map/Reduce job? Or may be I misunderstand something?
>
> BR,
> Igor Babkin, Mifors.com
>



-- 
-----李平

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message