crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-420) Breakpoints Not Working
Date Tue, 17 Jun 2014 20:20:06 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034304#comment-14034304
] 

Josh Wills commented on CRUNCH-420:
-----------------------------------

Chatting about this with [~mkwhitacre]-- is what we really want here just a way to signal
that a DoFn should be run exactly once? Like a boolean runExactlyOnce() method that could
be sent to the planner? Didn't we have this discussion before sometime?

> Breakpoints Not Working
> -----------------------
>
>                 Key: CRUNCH-420
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-420
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>            Assignee: Josh Wills
>         Attachments: Breakpoint2IT.java, CRUNCH-420.patch, testBreakpoint_plan.png
>
>
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint
to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't
have been repeated, but it was.
> I'll attach some supporting material.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message