gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GEARPUMP-249) reduce is not executed when following flatMap in Stream DSL
Date Wed, 04 Jan 2017 04:13:58 GMT

    [ https://issues.apache.org/jira/browse/GEARPUMP-249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797109#comment-15797109
] 

ASF GitHub Bot commented on GEARPUMP-249:
-----------------------------------------

Github user codecov-io commented on the issue:

    https://github.com/apache/incubator-gearpump/pull/127
  
    ## [Current coverage](https://codecov.io/gh/apache/incubator-gearpump/pull/127?src=pr)
is 70.39% (diff: 100%)
    > Merging [#127](https://codecov.io/gh/apache/incubator-gearpump/pull/127?src=pr) into
[master](https://codecov.io/gh/apache/incubator-gearpump/branch/master?src=pr) will increase
coverage by **0.01%**
    
    
    ```diff
    @@             master       #127   diff @@
    ==========================================
      Files           186        186          
      Lines          5988       5988          
      Methods        5469       5469          
      Messages          0          0          
      Branches        517        517          
    ==========================================
    + Hits           4214       4215     +1   
    + Misses         1774       1773     -1   
      Partials          0          0          
    ```
    
    ![Sunburst](https://codecov.io/gh/apache/incubator-gearpump/pull/127/graphs/sunburst.svg?src=pr&size=150)
    
    > Powered by [Codecov](https://codecov.io?src=pr). Last update [2783559...ddc1e98](https://codecov.io/gh/apache/incubator-gearpump/compare/2783559dbf1fe0dd5f090cece152bef65251d5b8...ddc1e98877326740481d76bbfb5c1646bd79fd4f?src=pr)


> reduce is not executed when following flatMap in Stream DSL
> -----------------------------------------------------------
>
>                 Key: GEARPUMP-249
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-249
>             Project: Apache Gearpump
>          Issue Type: Bug
>          Components: streaming
>    Affects Versions: 0.8.2
>            Reporter: Manu Zhang
>            Assignee: Manu Zhang
>             Fix For: 0.8.3
>
>
> The issue can be reproduced if a redundant {{map}} is added between {{groupBy}} and {{sum}}
> {code}
>     app.source(data.lines.toList, 1, "source").
>       // word => (word, count)
>       flatMap(line => line.split("[\\s]+")).map((_, 1)).
>       // (word, count1), (word, count2) => (word, count1 + count2)
>       groupByKey().sum.log
> {code}
> The problem is with {{AndThen#process}} method, where {{flatMap}} is lazily/ never executed.
> {code}
>   override def process(value: IN): TraversableOnce[OUT] = {
>     first.process(value).flatMap(second.process)
>   }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message