apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2096) Add blockThreshold parameter to FSInputModule
Date Thu, 26 May 2016 23:24:12 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303148#comment-15303148
] 

ASF GitHub Bot commented on APEXMALHAR-2096:
--------------------------------------------

Github user DT-Priyanka commented on a diff in the pull request:

    https://github.com/apache/incubator-apex-malhar/pull/287#discussion_r64837618
  
    --- Diff: library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileSplitter.java ---
    @@ -53,6 +53,7 @@
        * This is a threshold on the no. of blocks emitted per window. A lot of blocks emitted
        * per window can overwhelm the downstream operators. This setting helps to control
that.
        */
    +  @NotNull
    --- End diff --
    
    Yes right, let me change datatype to Integer.


> Add blockThreshold parameter to FSInputModule
> ---------------------------------------------
>
>                 Key: APEXMALHAR-2096
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2096
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Priyanka Gugale
>            Assignee: Priyanka Gugale
>
> FileSplitter is very fast, the downstream operators can't work at that speed, so we need
to limit the speed with which fileSplitter works.
> One way to do is limit number of blocks emitted per window.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message