Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Date: Tue, 23 Aug 2016 12:00:25 +0000 (UTC)
From: "Ron Hashimshony (JIRA)" <jira@apache.org>
To: crunch-dev@incubator.apache.org
Message-ID: <JIRA.12830942.1432023743000.382593.1471953625636@Atlassian.JIRA>
In-Reply-To: <JIRA.12830942.1432023743000@Atlassian.JIRA>
References: <JIRA.12830942.1432023743000@Atlassian.JIRA> <JIRA.12830942.1432023743490@arcas>
Subject: [jira] [Commented] (CRUNCH-519) Plan dot file can display more
 information
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 23 Aug 2016 12:00:27 -0000


    [ https://issues.apache.org/jira/browse/CRUNCH-519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432680#comment-15432680 ] 

Ron Hashimshony commented on CRUNCH-519:
----------------------------------------

[~jwills] So, we found a small bug and fixed in (in the auto/manual reducers logic), So i'm uploading the final patch...

> Plan dot file can display more information
> ------------------------------------------
>
>                 Key: CRUNCH-519
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-519
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Ron Hashimshony
>            Assignee: Josh Wills
>         Attachments: CRUNCH-519-1.diff, CRUNCH-519-2.patch, CRUNCH-519-3.patch, CRUNCH-519-4.patch, CRUNCH-519.diff
>
>
> The current plan dot file display nicely the jobs, with nice names and arrows.
> However it does not explain how the planner decided on the reducers number, which is based on the input data size, scale factor and desired size per reducer.
> I suggest adding this information to the dot file.
> An addition to the DotfileWriter class can do this easily.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)