crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Wills (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CRUNCH-525) The ExtractKeyFn is has an incorrect scale factor
Date Fri, 22 May 2015 18:41:17 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Wills resolved CRUNCH-525.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 0.13.0

Pushed to master.

> The ExtractKeyFn is has an incorrect scale factor
> -------------------------------------------------
>
>                 Key: CRUNCH-525
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-525
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.12.0
>            Reporter: Stephen Patel
>            Assignee: Josh Wills
>            Priority: Minor
>             Fix For: 0.13.0
>
>         Attachments: CRUNCH-525.patch, CRUNCH-525b.patch
>
>
> The ExtractKeyFn[0] used by the by[1] method of the PCollectionImpl is using the default
scale factor for a MapFn (1.0).  It should be using 1.0 + the scale factor of the wrapped
MapFn, in order to be accurate.
> [0]: https://github.com/apache/crunch/blob/master/crunch-core/src/main/java/org/apache/crunch/fn/ExtractKeyFn.java
> [1]: https://github.com/apache/crunch/blob/master/crunch-core/src/main/java/org/apache/crunch/impl/dist/collect/PCollectionImpl.java#L270



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message