crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CRUNCH-420) Breakpoints Not Working
Date Sun, 15 Jun 2014 12:28:01 GMT

    [ https://issues.apache.org/jira/browse/CRUNCH-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031866#comment-14031866
] 

Gabriel Reid commented on CRUNCH-420:
-------------------------------------

Yep, that looks like a bug to me. You can get it to work as you expect by calling {{materialize().iterator()}}
instead of just {{materialize()}} on the PCollection in question, but I believe it's wrong
that the call to materialize isn't currently having the same effect. 

I've taken a look, and haven't quite spotted how to fix it yet, but I'll keep going on it
unless [~jwills] knows how to deal with this off the top of his head.

> Breakpoints Not Working
> -----------------------
>
>                 Key: CRUNCH-420
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-420
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>         Attachments: Breakpoint2IT.java, testBreakpoint_plan.png
>
>
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint
to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't
have been repeated, but it was.
> I'll attach some supporting material.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message