crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephen Patel (JIRA)" <j...@apache.org>
Subject [jira] [Created] (CRUNCH-525) The ExtractKeyFn is has an incorrect scale factor
Date Thu, 21 May 2015 21:52:17 GMT
Stephen Patel created CRUNCH-525:
------------------------------------

             Summary: The ExtractKeyFn is has an incorrect scale factor
                 Key: CRUNCH-525
                 URL: https://issues.apache.org/jira/browse/CRUNCH-525
             Project: Crunch
          Issue Type: Bug
          Components: Core
    Affects Versions: 0.12.0
            Reporter: Stephen Patel
            Assignee: Josh Wills
            Priority: Minor


The ExtractKeyFn[0] used by the by[1] method of the PCollectionImpl is using the default scale
factor for a MapFn (1.0).  It should be using 1.0 + the scale factor of the wrapped MapFn,
in order to be accurate.

[0]: https://github.com/apache/crunch/blob/master/crunch-core/src/main/java/org/apache/crunch/fn/ExtractKeyFn.java
[1]: https://github.com/apache/crunch/blob/master/crunch-core/src/main/java/org/apache/crunch/impl/dist/collect/PCollectionImpl.java#L270





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message