crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CRUNCH-519) Plan dot file can display more information
Date Wed, 24 Aug 2016 03:38:20 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills resolved CRUNCH-519.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 0.15.0

Tested and pushed to master. Thanks [~ronhash]!

> Plan dot file can display more information
> ------------------------------------------
>
>                 Key: CRUNCH-519
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-519
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Ron Hashimshony
>            Assignee: Josh Wills
>             Fix For: 0.15.0
>
>         Attachments: CRUNCH-519-1.diff, CRUNCH-519-2.patch, CRUNCH-519-3.patch, CRUNCH-519-4.patch,
CRUNCH-519-5.patch, CRUNCH-519.diff
>
>
> The current plan dot file display nicely the jobs, with nice names and arrows.
> However it does not explain how the planner decided on the reducers number, which is
based on the input data size, scale factor and desired size per reducer.
> I suggest adding this information to the dot file.
> An addition to the DotfileWriter class can do this easily.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message