spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From andrewor14 <>
Subject [GitHub] spark pull request: [SPARK-6418] Add simple per-stage visualizatio...
Date Mon, 20 Apr 2015 22:45:18 GMT
Github user andrewor14 commented on the pull request:
    @pwendell talked about this and #2342 a little bit offline. Our feeling is that this is
a more elegant representation of task times than #2342, especially when there are many tasks
within a stage. One concern I have, however, what happens when you zoom (does it currently
support zooming?). It would make little sense to zoom without keeping the axes, but my impression
is that implementing this is pretty hard since we're directly using d3.
    Bonus: It doesn't have to be part of this patch, but it would really cool if there's a
mode where we can align the breakdown of the task times along the vertical axis. Right now
you can't really compare the serialization time of the first task with that of the last task,
let alone track whether it has grown incrementally over time. Realistically we will implement
this separately say for 1.5, but I imagine this bonus feature is gonna be immensely useful.

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message