crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <>
Subject [jira] [Updated] (CRUNCH-420) Breakpoints Not Working
Date Tue, 17 Jun 2014 20:07:15 GMT


Josh Wills updated CRUNCH-420:

    Attachment: CRUNCH-420.patch

So this patch makes [~aj987]'s integration test pass; basically any materialization that divides
the path between an input node and a GBK will result in a split into two jobs: one map-only
and one MapReduce.

> Breakpoints Not Working
> -----------------------
>                 Key: CRUNCH-420
>                 URL:
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>            Assignee: Josh Wills
>         Attachments:, CRUNCH-420.patch, testBreakpoint_plan.png
> Reading through CRUNCH-294, it looks like materialize is supposed to function as a breakpoint
to the planner. I've seen several plans where it appeared to me a particular DoFn shouldn't
have been repeated, but it was.
> I'll attach some supporting material.

This message was sent by Atlassian JIRA

View raw message