crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-420) Breakpoints Not Working
Date Mon, 16 Jun 2014 13:26:01 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032418#comment-14032418
] 

Gabriel Reid commented on CRUNCH-420:
-------------------------------------

Ok, that now fully refreshes my memory on the subject (as well as being in line with what
I saw in the code, unsurprisingly).

>From what I've seen in the code a slightly simpler version of the inter-GBK edge splitting
can be done to handle this situation as well. My thinking is that any edge that ends in a
materialization output could be dropped in as a replacement for the first portion of other
edges that start from the same vertex and have a NodePath that is a superset of the materialization
NodePath -- does that make sense?


> Breakpoints Not Working
> -----------------------
>
>                 Key: CRUNCH-420
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-420
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>            Assignee: Josh Wills
>         Attachments: Breakpoint2IT.java, testBreakpoint_plan.png
>
>
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint
to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't
have been repeated, but it was.
> I'll attach some supporting material.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message