hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: expressing job anti-affinity in Yarn.
Date Thu, 09 Jan 2014 17:00:20 GMT
YARN-1042 add ability to specify affinity/anti-affinity in container

On Thu, Jan 9, 2014 at 8:48 AM, ricky l <rickylee0815@gmail.com> wrote:

> Hi all,
> Is it possible to express the job anti-affinity in the Yarn-based hadoop?
> I have a job that is very IO-intensive, and I want to spread the tasks
> across all available machines. In a default Yarn RM scheduler, it seems
> many tasks are scheduled in one machine while others are idle.
> thanks.

View raw message