spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tgravescs <...@git.apache.org>
Subject [GitHub] spark pull request: Modify default YARN memory_overhead-- from an ...
Date Fri, 19 Sep 2014 13:07:01 GMT
Github user tgravescs commented on the pull request:

    https://github.com/apache/spark/pull/1391#issuecomment-56174217
  
    @mridulm  any comments?
    
    I'm ok with it if its a consistent problem for users.  One thing we definitely need to
do is document it and possibly look at including better log and error messages. We should
at least log the size of the overhead it calculates.  It would also be nice to log what it
is when we fail to get a container large enough or it fails due to the cluster max allocation
limit was hit.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message