kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Neha Narkhede <neha.narkh...@gmail.com>
Subject Re: Consumer not consuming.
Date Sat, 04 Jan 2014 18:54:58 GMT
Could you share the logs of both consumers - account-access-
hadoop-consumer_tm1mwdpl04 and account-access-
hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0

Also, take thread dumps on both consumer processes and share that.

Thanks,
Neha


On Sat, Jan 4, 2014 at 9:56 AM, Seshadri, Balaji
<Balaji.Seshadri@dish.com>wrote:

> Consumer offset checker shows its connected to
> consumer(account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0)
> but that consumer is not started,what could be reason its showing its
> connected.
>
> Another question is why is it not getting rebalanced to another
> consumer(account-access-hadoop-consumer_tm1mwdpl04) we have running.
>
> Group           Topic                          Pid Offset          logSize
>         Lag             Owner
> account-access-hadoop-consumer account-access                 0   8802
>        8858            56
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 1   8159
>        8216            57
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 2   8742
>        8895            153
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 3   11126
>         11132           6
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 4   13471
>         13562           91
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 5   16731
>         16748           17
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 6   16890
>         16928           38
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 7   6454
>        6486            32
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 8   5988
>        6075            87
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 9   7683
>        7693            10
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 10  11121
>         11441           320
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 11  9848
>        9954            106
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 12  10222
>         10267           45
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 13  7878
>        7967            89
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 14  12736
>         12853           117
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 15  18634
>         18636           2
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 16  18206
>         18252           46
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 17  20818
>         20830           12
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 18  11514
>         11522           8
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 19  12188
>         12230           42
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 20  19373
>         19438           65
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 21  11892
>         11892           0
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 22  12456
>         12496           40
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 23  12971
>         13060           89
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 24  18675
>         18740           65
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 25  11346
>         11353           7
> account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
> account-access-hadoop-consumer account-access                 26  12297
>         12337           40
>  account-access-hadoop-consumer_tm1mwdpl03-1383065261413-15d3cb41-0
>
> It would be great if you guys shed some light,we are in our weekends
> trying to resolve this issue :)
>
> Thanks,
>
> Balaji
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message