ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-429) Implement IgniteStormStreamer to stream data from Apache Storm
Date Mon, 28 Sep 2015 13:53:04 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933311#comment-14933311
] 

ASF GitHub Bot commented on IGNITE-429:
---------------------------------------

GitHub user murador opened a pull request:

    https://github.com/apache/ignite/pull/110

    IGNITE-429:  Implement IgniteStormStreamer to stream data from Apache Storm

    The test was successful with the latest changes, we use a simulated topology. The operation
of the stream is different compared to the one described in the guidelines because the integration
is via a Storm Bolt. The operation will be described here : https://cwiki.apache.org/confluence/display/IGNITE/Storm+Integration+Guidelines

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/murador/ignite IGNITE-429

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/ignite/pull/110.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #110
    
----
commit a7a7e9b1703c4a8a3bcd805893f88c05af1903ae
Author: murador <mitenick@gmail.com>
Date:   2015-09-13T16:51:19Z

    IGNITE-708 remove refreshPartitions on ResendTimeoutObject

commit bf3070b838fbdedbb95b8e0bf95ffbef48aeb71b
Author: glutters <mitenick@gmail.com>
Date:   2015-09-19T14:22:19Z

    IGNITE-429 definition of a draft of  StormStreamer class

commit 29b889abff0056b5906cdee9843d8e177fb8da40
Author: glutters <mitenick@gmail.com>
Date:   2015-09-19T14:22:43Z

    IGNITE-429 definition of a draft of  StormStreamer class 2

commit f15be0799c80429319ec1a4164f3fb89ff57ec34
Author: glutters <mitenick@gmail.com>
Date:   2015-09-19T15:03:03Z

    IGNITE-429 definition of a draft of StormStreamer with mod

commit f8c46d0d6638856850aab56903f5b0555c98785c
Author: glutters <mitenick@gmail.com>
Date:   2015-09-19T16:06:18Z

    IGNITE-429 Ignite Bolt included

commit 886abb919b92dd399f96370a2f3a22467187a98a
Author: glutters <mitenick@gmail.com>
Date:   2015-09-19T16:32:08Z

    Sinc of the repo

commit 43f1f9c3063e30f950e593ac36e438152b60a3c1
Author: glutters <mitenick@gmail.com>
Date:   2015-09-20T10:11:03Z

    IGNITE-429 - first commit on branch

commit ba59921b99beee5e527a56822cf34dad669e75de
Author: glutters <mitenick@gmail.com>
Date:   2015-09-20T13:41:51Z

    IGNITE-429 - finish implementation - going to unit test

commit 11eafbc09ece64d740639b752da0e39471833919
Author: Gianfranco Murador <mitenick@gmail.com>
Date:   2015-09-20T13:45:29Z

    Ugly Linux backup file
    
    Ugly Linux backup file

commit e9ff1274abdd9feb0a50713e0a6ba9c4380f205a
Author: glutters <mitenick@gmail.com>
Date:   2015-09-20T14:13:24Z

    IGNITE-429 - fix

commit 693882e9bb34adced8a98c6cf84c8fd11836b8ab
Author: glutters <mitenick@gmail.com>
Date:   2015-09-20T14:16:11Z

    Merge branch 'IGNITE-429' of https://github.com/murador/ignite into IGNITE-429

commit 3e02c2a7918db0b6756b0fff0058fc4e22f05abb
Author: glutters <mitenick@gmail.com>
Date:   2015-09-26T13:43:39Z

    IGNITE-429 - unit test created

commit 9ace43739306b68eba6bf7e0cc818ecadbb5befe
Author: glutters <mitenick@gmail.com>
Date:   2015-09-26T14:46:16Z

    fix compilatio

commit 71994a71f58cf616ecc3d8d55e4d1ea5f29fcaef
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T10:57:27Z

    IGNITE-429 completed testing

commit 0f29871b54d6bf621db1b2efe95f32c6531c8527
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T10:57:56Z

    IGNITE-429 completed

commit 28dfa98ca204a7cfd2f1143e7b55afaebc871b7a
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T11:04:24Z

    IGNITE-429 completed

commit 87db3121d1f37ccaa395f6af90c9eb56c1567c51
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T12:09:57Z

    IGNITE-429 completed

commit 7d359e272d83d861bd4cab995778528388faa8db
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T12:31:25Z

    IGNITE-429 completed

commit a4578dab26489db673a2e1eb573b59a509a88e85
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T12:38:34Z

    IGNITE-429 completed

commit a5ea969f1f2cb8d0475f8da720c97bb94eb008e7
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T12:46:23Z

    IGNITE-429 completed

commit 46230b6afff7bf6f87d0af6b37c3dc44af8e91c7
Author: glutters <mitenick@gmail.com>
Date:   2015-09-27T14:37:22Z

    merge commit

commit 8cf75a9f7937c9a28c846c916dfcdaa4ee2e9298
Author: glutters <mitenick@gmail.com>
Date:   2015-09-28T10:42:29Z

    Fix timeout in unit test

commit 9f48ce40efa2949ec3d5a5aadf73d473d325e7bf
Author: glutters <mitenick@gmail.com>
Date:   2015-09-28T13:21:31Z

    IGNITE-429 - set up unit test with simulated topology

----


> Implement IgniteStormStreamer to stream data from Apache Storm
> --------------------------------------------------------------
>
>                 Key: IGNITE-429
>                 URL: https://issues.apache.org/jira/browse/IGNITE-429
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Chandresh Pancholi
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load.
It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> See [Apache Storm|https://storm.apache.org/] for more information.
> We should create {{IgniteStormStreamer}} which will consume tuples from Storm and stream
them into Ignite caches. 
> More details to follow, but to the least we should be able to:
> - Convert/Intercept Storm tuples to Ignite data using an optional pluggable converter.
> - Specify the cache name for the Ignite cache to load data into.
> - Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message