spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From squito <>
Subject [GitHub] spark issue #19145: [spark-21933][yarn] Spark Streaming request more executo...
Date Tue, 19 Sep 2017 20:59:53 GMT
Github user squito commented on the issue:
    I'm not sure I totally follow the sequence of events, but I get the feeling this should
be handled in yarn, not spark.
    Also, I agree with Jerry, it seems like your `completedContainerIdSet` may grow continuously.
 You'll remove from it *if* you happen to get a duplicate message.  But I think in most cases
you will not a get duplicate message, if I understand correctly.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message