kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vahid Hashemian (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Deleted] (KAFKA-3129) Console Producer/Consumer Issue
Date Wed, 01 Jun 2016 20:26:59 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vahid Hashemian updated KAFKA-3129:
-----------------------------------
    Comment: was deleted

(was: I can still produce this issue with the current trunk code, when {{request-required-acks}}
is the default {{0}}.
I simply run the console producer like this:
{quote}
{{seq 10000 | bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test}}
{quote}

And check the offset using
{quote}
{{bin/kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9092 --topic t1
--time -1}}
{quote}

After a few tries I see that the returned offset falls behind.)

> Console Producer/Consumer Issue
> -------------------------------
>
>                 Key: KAFKA-3129
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3129
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer, producer 
>    Affects Versions: 0.9.0.0
>            Reporter: Vahid Hashemian
>            Assignee: Neha Narkhede
>         Attachments: kafka-3129.mov, server.log.abnormal.txt, server.log.normal.txt
>
>
> I have been running a simple test case in which I have a text file {{messages.txt}} with
1,000,000 lines (lines contain numbers from 1 to 1,000,000 in ascending order). I run the
console consumer like this:
> {{$ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test}}
> Topic {{test}} is on 1 partition with a replication factor of 1.
> Then I run the console producer like this:
> {{$ bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test < messages.txt}}
> Then the console starts receiving the messages. And about half the times it goes all
the way to 1,000,000. But, in other cases, it stops short, usually at 999,735.
> I tried running another console consumer on another machine and both consumers behave
the same way. I can't see anything related to this in the logs.
> I also ran the same experiment with a similar file of 10,000 lines, and am getting a
similar behavior. When the consumer does not receive all the 10,000 messages it usually stops
at 9,864.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message