crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabriel Reid (JIRA)" <>
Subject [jira] [Commented] (CRUNCH-420) Breakpoints Not Working
Date Sun, 15 Jun 2014 12:28:01 GMT


Gabriel Reid commented on CRUNCH-420:

Yep, that looks like a bug to me. You can get it to work as you expect by calling {{materialize().iterator()}}
instead of just {{materialize()}} on the PCollection in question, but I believe it's wrong
that the call to materialize isn't currently having the same effect. 

I've taken a look, and haven't quite spotted how to fix it yet, but I'll keep going on it
unless [~jwills] knows how to deal with this off the top of his head.

> Breakpoints Not Working
> -----------------------
>                 Key: CRUNCH-420
>                 URL:
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>         Attachments:, testBreakpoint_plan.png
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint
to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't
have been repeated, but it was.
> I'll attach some supporting material.

This message was sent by Atlassian JIRA

View raw message