ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-530) Implement IgniteTwitterStreamer to stream data from Twitter feeds
Date Fri, 25 Sep 2015 18:57:04 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14908521#comment-14908521
] 

ASF GitHub Bot commented on IGNITE-530:
---------------------------------------

GitHub user sylentprayer opened a pull request:

    https://github.com/apache/ignite/pull/106

    Ignite 530

    Fixes for https://issues.apache.org/jira/browse/IGNITE-530?focusedCommentId=14904705&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14904705

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sylentprayer/ignite ignite-530

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/ignite/pull/106.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #106
    
----
commit 8a4ef1419c2b8fd720be3a65b53f9a56a6eea524
Author: sylentprayer <un4given>
Date:   2015-09-19T17:41:49Z

    IGNITE-530 development of Twitter data streamer based on Twitter Streaming API (public
statuses).
    This data streamer requires valid Twitter OAuth credentials, so tests are skipped by default
(in this module's pom.xml).
    Need to set these OAuth keys in test/resources/twitter.properties and enable tests.
    
    Test covers only statuses filter API endpoint as firehose and site stream requires special
permissions.

commit e427113a0a1eb31b3db23dcee9eb057b17d0fdf2
Author: sylentprayer <un4given>
Date:   2015-09-25T18:40:44Z

    IGNITE-530 fixes for comment https://issues.apache.org/jira/browse/IGNITE-530?focusedCommentId=14904705&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14904705

----


> Implement IgniteTwitterStreamer to stream data from Twitter feeds
> -----------------------------------------------------------------
>
>                 Key: IGNITE-530
>                 URL: https://issues.apache.org/jira/browse/IGNITE-530
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Lalit Kumar Jha
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load.
It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> We should create {{IgniteTwitterStreamer}} which will consume messages from Twitter and
stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Twitter data to Ignite data using an optional pluggable converter.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message