hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hariharan <hariharan...@gmail.com>
Subject Re: Phase level Scheduling algorithm in heterogeneous cluster
Date Sat, 22 Apr 2017 04:26:31 GMT
Regarding the implementation - without knowing much about the algorithm - I
would guess you would at minimum need to implement a new scheduler - see
for some examples (fair/capacity/fifo). You may also be able to modify one
of the existing schedulers if the new algorithm isn't too different. You
would likely also need to change the MRAppMaster
and the Mapper
and Reducer
classes to work with this algorithm.


On Sat, Apr 22, 2017 at 7:04 AM, Ahmed Altaj <ahmed.altaj@yahoo.com.invalid>

> Hi,
> I'm trying to deploy PRISM algorithm which proposed in IEEE paper title
> "prism: Fine-Grained Resource-Aware Scheduling for MapReduce", for phase
> level scheduling work  in homogeneous cluster.
> I'm stack with first step how to implement this algorithm and configure
> it, which parts i have to change.
> Best Regards...
> Ahmed

View raw message