ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anton Vinogradov (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (IGNITE-530) Implement IgniteTwitterStreamer to stream data from Twitter feeds
Date Mon, 28 Sep 2015 09:46:04 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14910207#comment-14910207
] 

Anton Vinogradov edited comment on IGNITE-530 at 9/28/15 9:45 AM:
------------------------------------------------------------------

Hello Lalit, 
Pull request required some changes before next review:
1) Pull request for this issue should contain only changes related to this issue. 
2) All fields should be marked as final in case they are immutable.
3) According to https://cwiki.apache.org/confluence/display/IGNITE/Coding+Guidelines#CodingGuidelines-SemanticUnits
 To simplify the recognition of semantic units, the every line of the source code should be
separated by one empty line except some cases, see wiki for details.
4) Dependency exclusion at pom.xml should be specified only for dependencies used at project.
Most of dependencies excluded for wiremock are redundant.
5) Huge string like 'tweet' should be generated at test start, if possible.  


was (Author: avinogradov):
Hello Lalit, 
Why you joined IGNITE-530 & IGNITE-815 at one pull request?

> Implement IgniteTwitterStreamer to stream data from Twitter feeds
> -----------------------------------------------------------------
>
>                 Key: IGNITE-530
>                 URL: https://issues.apache.org/jira/browse/IGNITE-530
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Lalit Kumar Jha
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load.
It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> We should create {{IgniteTwitterStreamer}} which will consume messages from Twitter and
stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Twitter data to Ignite data using an optional pluggable converter.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message