spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From squito <...@git.apache.org>
Subject [GitHub] spark issue #19145: [spark-21933][yarn] Spark Streaming request more executo...
Date Tue, 19 Sep 2017 20:59:53 GMT
Github user squito commented on the issue:

    https://github.com/apache/spark/pull/19145
  
    I'm not sure I totally follow the sequence of events, but I get the feeling this should
be handled in yarn, not spark.
    
    Also, I agree with Jerry, it seems like your `completedContainerIdSet` may grow continuously.
 You'll remove from it *if* you happen to get a duplicate message.  But I think in most cases
you will not a get duplicate message, if I understand correctly.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message