hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Lilley <john.lil...@redpoint.net>
Subject connection overload strategies
Date Sat, 21 Sep 2013 13:55:35 GMT
If my YARN application tasks are all reading/writing HDFS simultaneously and some node is unable
to honor a connection request because it is overloaded, what happens?  I've seen HDFS attempt
to retry connections.
For that matter, how does MR under YARN deal with connection overload during the shuffle phase,
where it seems that such cases would be likely?
Thanks
John



Mime
View raw message