ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (IGNITE-530) Implement IgniteTwitterStreamer to stream data from Twitter feeds
Date Sat, 19 Sep 2015 17:53:04 GMT

    [ https://issues.apache.org/jira/browse/IGNITE-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14877229#comment-14877229
] 

ASF GitHub Bot commented on IGNITE-530:
---------------------------------------

GitHub user sylentprayer opened a pull request:

    https://github.com/apache/ignite/pull/102

    IGNITE-530 development of Twitter data streamer

    IGNITE-530 development of Twitter data streamer based on Twitter Streaming API (public
statuses).
    
    This data streamer requires valid Twitter OAuth credentials, so tests are skipped by default
(in this module's pom.xml).
    Need to set these OAuth keys in test/resources/twitter.properties and enable tests.
    
    Test covers only statuses filter API endpoint as firehose and site stream requires special
permissions.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sylentprayer/ignite ignite-530

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/ignite/pull/102.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #102
    
----
commit 8a4ef1419c2b8fd720be3a65b53f9a56a6eea524
Author: sylentprayer <un4given>
Date:   2015-09-19T17:41:49Z

    IGNITE-530 development of Twitter data streamer based on Twitter Streaming API (public
statuses).
    This data streamer requires valid Twitter OAuth credentials, so tests are skipped by default
(in this module's pom.xml).
    Need to set these OAuth keys in test/resources/twitter.properties and enable tests.
    
    Test covers only statuses filter API endpoint as firehose and site stream requires special
permissions.

----


> Implement IgniteTwitterStreamer to stream data from Twitter feeds
> -----------------------------------------------------------------
>
>                 Key: IGNITE-530
>                 URL: https://issues.apache.org/jira/browse/IGNITE-530
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: streaming
>            Reporter: Dmitriy Setrakyan
>            Assignee: Lalit Kumar Jha
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under high load.
It was previously named {{IgniteDataLoader}}, see ticket IGNITE-394.
> We should create {{IgniteTwitterStreamer}} which will consume messages from Twitter and
stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Twitter data to Ignite data using an optional pluggable converter.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message