gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Qi Shu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GEARPUMP-122) KafkaSource Stuck
Date Thu, 12 May 2016 02:32:12 GMT

     [ https://issues.apache.org/jira/browse/GEARPUMP-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Qi Shu updated GEARPUMP-122:
----------------------------
    Description: 
Kafka's version is 2.10-0.8.2.0 and deployed on a cluster of 3 machines. Gearpump's version
is 2.11-0.8.0 and deployed on local mode.
The app running on gearpump is a java example Kafka2Kafka.
The topic has millions of messages in It。
After app started for a while, there were no messages received from kafka, but kafka console
can recevie messages from that topic.
And if I use the kafka source withoud offset checkpoint, then messages begin to flow.
"screenshot-1.png" means app started for 7 minutes  and no messages received from kafka source.
"2.png" was a screen shot of JProfiler, I use JProfiler to watch the thread of Gearpump, and
it seems the kafka source stucked when doing offset checkpoint.


  was:
Kafka Version: 2.10-0.8.2.0
When Using KafkaSrouce, after app started for a while, there were no messages received from
kafka, but kafka console can recevie messages from that topic.



> KafkaSource Stuck
> -----------------
>
>                 Key: GEARPUMP-122
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-122
>             Project: Apache Gearpump
>          Issue Type: Bug
>          Components: kafka
>    Affects Versions: 0.8.0
>            Reporter: Qi Shu
>            Assignee: Manu Zhang
>         Attachments: 2.png, screenshot-1.png
>
>
> Kafka's version is 2.10-0.8.2.0 and deployed on a cluster of 3 machines. Gearpump's version
is 2.11-0.8.0 and deployed on local mode.
> The app running on gearpump is a java example Kafka2Kafka.
> The topic has millions of messages in It。
> After app started for a while, there were no messages received from kafka, but kafka
console can recevie messages from that topic.
> And if I use the kafka source withoud offset checkpoint, then messages begin to flow.
> "screenshot-1.png" means app started for 7 minutes  and no messages received from kafka
source.
> "2.png" was a screen shot of JProfiler, I use JProfiler to watch the thread of Gearpump,
and it seems the kafka source stucked when doing offset checkpoint.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message