hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ahmad Humayun" <ahmad.hu...@gmail.com>
Subject Re: need help with hadoop job stats
Date Sun, 14 Sep 2008 06:06:11 GMT
Has anybody run computations over Hadoop, which took days to complete. Just
wondering! I believe that if the scenarios run by Yahoo! (as pointed out by
the web-link) were run on a smaller cluster, this computation might take
days, not hours....is that true?


regards,

On Sat, Sep 13, 2008 at 9:15 PM, Arun C Murthy <acm@yahoo-inc.com> wrote:

>
> On Sep 13, 2008, at 5:24 AM, momina khan wrote:
>
>  hi
>>
>> if you do a lot of hadoop computation can you tell me how much maximum
>> time
>> you have encountered with a  hadoop job. can you state the type
>> of computation (algorithm) and also the cluster setup it was run on, plus
>> the input data size. we are looking for computations that have taken a
>> large
>> amount of time.
>>
>>
>
> http://developer.yahoo.com/blogs/hadoop/2008/02/yahoo-worlds-largest-production-hadoop.html
>  ?
>
> Arun
>
>  cheers
>> momina
>>
>
>


-- 
Ahmad Humayun
Research Associate
Computer Science Dpt., LUMS
http://suraj.lums.edu.pk/~ahmadh
+92 321 4457315

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message