spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mallman <>
Subject [GitHub] spark pull request: [SPARK-8982][Core] Worker hostnames not showin...
Date Thu, 17 Dec 2015 18:02:05 GMT
Github user mallman commented on the pull request:
    To add my two cents, I think that to call this change "cosmetic" is strictly true but
underrates its value. In our case we have additional monitoring systems that report based
on local hostname. When we want to investigate an issue we see in monitoring in the Spark
UI, not having the hostnames in the UI makes it more difficult than it was in Spark 1.3. Also,
because we're in AWS and use amazon's DNS for reverse lookup, we can't do a reverse lookup
on the IP to see the hostname. (I know that's our problem—just illustrating the impact from
our perspective.)
    With regard to a fix, I'm also in favor of a simple patch to ``. In fact,
it's something we're going to try ourselves. I'll try to get it done today and will report
here on our experience.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message