streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (STREAMS-72) ElasticsearchPersistWriter fails to flush low volume streams
Date Fri, 02 May 2014 17:29:14 GMT

    [ https://issues.apache.org/jira/browse/STREAMS-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987975#comment-13987975
] 

ASF GitHub Bot commented on STREAMS-72:
---------------------------------------

GitHub user mfranklin opened a pull request:

    https://github.com/apache/incubator-streams/pull/7

    STREAMS-72 - Updated Elasticsearch and LocalStreamBuilder

    This makes significant changes to the LocalStreamBuilder and associated tasks, as well
as the ElasticsearchPersistWriter Locking

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/incubator-streams STREAMS-72

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-streams/pull/7.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #7
    
----
commit c837a2cf8800efd324003ba5a9299c16b9f8701a
Author: mfranklin <mfranklin@apache.org>
Date:   2014-05-01T17:59:32Z

    Updated Persist writer to have a configurable background flush thread

commit 6934c7a0d4c479392c6c147d00af8cd9ed7b3c44
Author: mfranklin <mfranklin@apache.org>
Date:   2014-05-01T22:45:30Z

    Updated termination process

commit fb8f7aea3032296a4c0dd779aca976104de44d61
Author: mfranklin <mfranklin@apache.org>
Date:   2014-05-01T23:53:18Z

    Fixed deadlock issue

commit f62afa57ce5ca19d639c84e89ea29f998a16fbe5
Author: mfranklin <mfranklin@apache.org>
Date:   2014-05-01T23:54:56Z

    Fixed issue where exception terminated thread and it wouldn't start again

----


> ElasticsearchPersistWriter fails to flush low volume streams
> ------------------------------------------------------------
>
>                 Key: STREAMS-72
>                 URL: https://issues.apache.org/jira/browse/STREAMS-72
>             Project: Streams
>          Issue Type: Bug
>            Reporter: Matt Franklin
>
> When a stream is very low volume, the ElasticsearchPersistWriter may not ever hit its
threshold to flush causing data loss.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message