hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Павел Мезенцев <pa...@mezentsev.org>
Subject Push or pull in yarn
Date Tue, 03 Mar 2015 02:50:45 GMT
Hi All!


Resently I read an article about facebook's corona
https://www.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-more-efficiently-with-corona/10151142560538920

they solved in mr1 pull based task assignment:
task trackers send heartbeat to jobtracker and recive new tasks  in
respond.
This approach wasted 10-20 seconds for each tasks.

My question is about YARN: was this trouble solved in YARN or not?

Best regards,
Mezentsev Pavel

Mime
View raw message