crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <>
Subject [jira] [Updated] (CRUNCH-519) Plan dot file can display more infromation
Date Thu, 21 May 2015 20:44:17 GMT


Josh Wills updated CRUNCH-519:
    Attachment: CRUNCH-519-2.patch

Here's a version of this that fixes some broken tests and uses StringBuilders for creating
the label info. Two things sort of bug me-- mutable state inside of PGroupedTableImpl to set
the numreducers (I get why we need to do it, but it bugs me), and I'd like a clearer labeling
for the manual vs. automatic num reducer messaging that isn't too wordy. [~mkwhitacre], what
do you think?

> Plan dot file can display more infromation
> ------------------------------------------
>                 Key: CRUNCH-519
>                 URL:
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Ron Hashimshony
>            Assignee: Josh Wills
>         Attachments: CRUNCH-519-1.diff, CRUNCH-519-2.patch, CRUNCH-519.diff
> The current plan dot file display nicely the jobs, with nice names and arrows.
> However it does not explain how the planner decided on the reducers number, which is
based on the input data size, scale factor and desired size per reducer.
> I suggest adding this information to the dot file.
> An addition to the DotfileWriter class can do this easily.

This message was sent by Atlassian JIRA

View raw message