spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jerryshao <...@git.apache.org>
Subject [GitHub] spark issue #19396: [SPARK-22172][CORE] Worker hangs when the external shuff...
Date Mon, 16 Oct 2017 08:10:33 GMT
Github user jerryshao commented on the issue:

    https://github.com/apache/spark/pull/19396
  
    Sorry for the late response. I understand you purpose now. I think such behavior discrepancy
is not a big problem. 
    
    I guess the reason why NM still run with exception is that NM doesn't serve only for Spark,
but also MR/TEZ, so the failure of Spark external service should not affect MR's.
    
    Based on your comment above, I don't have a strong preference on either, I think both
are OK. Maybe you can ping others to get their feedbacks.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message