hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugene Kirpichov <ekirpic...@gmail.com>
Subject Re: data locality
Date Wed, 26 Oct 2011 09:22:34 GMT
Thanks!

2011/10/26 Steve Loughran <stevel@apache.org>:
> On 26/10/11 05:22, Eugene Kirpichov wrote:
>>
>> But I guess it isn't always possible to achieve optimal scheduling, right?
>> What's done then; any account for network topology perhaps?
>
> I'd recommend this paper if you are curious, it explains the Fair Scheduler
>
> http://www.cs.berkeley.edu/~matei/papers/2010/eurosys_delay_scheduling.pdf
>
> You can plug in different schedulers with different policies if you want
>



-- 
Eugene Kirpichov
Principal Engineer, Mirantis Inc. http://www.mirantis.com/
Editor, http://fprog.ru/

Mime
View raw message