gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "darion yaphet (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GEARPUMP-121) DataSourceProcessor and DataSinkProcessor default parallelism
Date Sun, 15 May 2016 15:03:12 GMT

    [ https://issues.apache.org/jira/browse/GEARPUMP-121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283856#comment-15283856
] 

darion yaphet commented on GEARPUMP-121:
----------------------------------------

I think Storm is very similar with Gearpump , but Spark is running a periodic job on mini
batch .

In Apache Storm setSpout and setBolt have provide default parallelism , Spark is running periodic
job on a mini batch so it don't have the same problem with Storm and Gearpump

I don't have used Apache Flink but in Flink Example :  [WikipediaAnalysis |https://ci.apache.org/projects/flink/flink-docs-release-1.0/quickstart/run_example_quickstart.html]
it don't appoint out parallelism so it's maybe have a default value and could using setParallelism
to set it :)

> DataSourceProcessor and DataSinkProcessor default parallelism
> -------------------------------------------------------------
>
>                 Key: GEARPUMP-121
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-121
>             Project: Apache Gearpump
>          Issue Type: Improvement
>          Components: streaming
>    Affects Versions: 0.8.0, 0.8.1
>            Reporter: darion yaphet
>            Assignee: darion yaphet
>            Priority: Minor
>
> Set DataSourceProcessor and DataSinkProcessor's default parallelism value to 1. When
user startup a processor could don't set parallelism .



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message