reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brian Cho (JIRA)" <>
Subject [jira] [Commented] (REEF-771) Locality-aware Task Scheduler
Date Tue, 19 Jan 2016 12:29:39 GMT


Brian Cho commented on REEF-771:

Hi [~shahankhatch] -- overall that sounds good. I'm looking forward to your implementation

REEF tries to avoid inheritance (extending classes), favoring composition instead. Fortunately,
Tang's injection facilities are nice for this. For example, you may want to keep the Scheduler
class, but inject an interface into it that specifically deals with scheduling on an allocated
evaluator (there would be two implementations: the original logic, and the locality-aware

> Locality-aware Task Scheduler
> -----------------------------
>                 Key: REEF-771
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF Examples
>            Reporter: Byung-Gon Chun
> The current TaskScheduler example does not consider data locality when tasks are launched.
A nice extension of the example is to consider data locality to schedule tasks when data's
stored in HDFS. 

This message was sent by Atlassian JIRA

View raw message