apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2096) Add blockThreshold parameter to FSInputModule
Date Fri, 27 May 2016 00:01:23 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303211#comment-15303211

ASF GitHub Bot commented on APEXMALHAR-2096:

Github user chandnisingh commented on a diff in the pull request:

    --- Diff: library/src/main/java/com/datatorrent/lib/io/fs/AbstractFileSplitter.java ---
    @@ -53,6 +53,7 @@
        * This is a threshold on the no. of blocks emitted per window. A lot of blocks emitted
        * per window can overwhelm the downstream operators. This setting helps to control
    +  @NotNull
    --- End diff --
    It will because min constraint is 1. By default the field will be assigned 0. So the user
will have to change the value.  Please don't change types 

> Add blockThreshold parameter to FSInputModule
> ---------------------------------------------
>                 Key: APEXMALHAR-2096
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2096
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Priyanka Gugale
>            Assignee: Priyanka Gugale
> FileSplitter is very fast, the downstream operators can't work at that speed, so we need
to limit the speed with which fileSplitter works.
> One way to do is limit number of blocks emitted per window.

This message was sent by Atlassian JIRA

View raw message