streams-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (STREAMS-311) TwitterUserInformationProvider stalls with > 20 items provided
Date Tue, 26 May 2015 00:05:03 GMT

    [ https://issues.apache.org/jira/browse/STREAMS-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558591#comment-14558591
] 

ASF GitHub Bot commented on STREAMS-311:
----------------------------------------

Github user steveblackmon commented on a diff in the pull request:

    https://github.com/apache/incubator-streams/pull/217#discussion_r30998066
  
    --- Diff: streams-contrib/streams-provider-twitter/src/main/java/org/apache/streams/twitter/provider/TwitterFollowingProviderTask.java
---
    @@ -141,7 +141,7 @@ else if( endpoint.equals("friends") )
                 catch(Exception e) {
                     keepTrying += TwitterErrorHandler.handleTwitterError(client, e);
                 }
    -        } while (curser != 0 && keepTrying < 10);
    +        } while (curser != 0 && keepTrying < 50);
    --- End diff --
    
    that would be a better approach for sure.
    
    reversed this line and created STREAMS-330.


> TwitterUserInformationProvider stalls with > 20 items provided
> --------------------------------------------------------------
>
>                 Key: STREAMS-311
>                 URL: https://issues.apache.org/jira/browse/STREAMS-311
>             Project: Streams
>          Issue Type: Bug
>            Reporter: Steve Blackmon
>
> The way parallelism is handled in TwitterUserInformationProvider can cause the provider
to stall when more threads are created than the size of the execution service queue which
is hard-coded to twenty.
> The size of the execution service queue should equal the number of threads to ensure
that startStream() does not block trying to add more threads, because until startStream()
completes the local runtime does not poll readCurrent().



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message