ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dmitriy Setrakyan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-536) Implement IgniteKinesisStreamer to stream data from Amazon Kinesis service
Date Sat, 09 May 2015 16:46:59 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14536755#comment-14536755

Dmitriy Setrakyan commented on IGNITE-536:


Sorry for a bit of a late reply (somehow I missed your initial comment).

There is plenty of user-based documentation for streaming and caching on Ignite website. There
are also many examples in {{examples}} module. I would start from there. Once you get familiar,
please post your thoughts here with design notes for Kinesis integration (it should be in
line with other streaming work handled under IGNITE-108).

Once we agree on the design notes, I will add you to Ignite contributors and assign this ticket
to you.

> Implement IgniteKinesisStreamer to stream data from Amazon Kinesis service
> --------------------------------------------------------------------------
>                 Key: IGNITE-536
>                 URL: https://issues.apache.org/jira/browse/IGNITE-536
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load.
It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> See [Amazon Kinesis|http://aws.amazon.com/kinesis/] site for more info.
> We should create {{IgniteKinesisStreamer}} which will consume messages from Amazon Kinesis
and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Kinesis messages to Ignite data using an optional pluggable converter. If not
provided, we should have some default mechanism.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.

This message was sent by Atlassian JIRA

View raw message