kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manikumar Reddy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-2159) offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored
Date Tue, 17 May 2016 12:52:12 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Manikumar Reddy updated KAFKA-2159:
-----------------------------------
    Resolution: Duplicate
        Status: Resolved  (was: Patch Available)

> offsets.topic.segment.bytes and offsets.topic.retention.minutes are ignored
> ---------------------------------------------------------------------------
>
>                 Key: KAFKA-2159
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2159
>             Project: Kafka
>          Issue Type: Bug
>          Components: offset manager
>    Affects Versions: 0.8.2.1
>            Reporter: RafaƂ Boniecki
>            Assignee: Manikumar Reddy
>              Labels: newbie
>         Attachments: KAFKA-2159.patch, KAFKA-2159_2015-06-17_11:44:03.patch, KAFKA-2159_2015-07-10_21:14:26.patch
>
>
> My broker configuration:
> {quote}offsets.topic.num.partitions=20
> offsets.topic.segment.bytes=10485760
> offsets.topic.retention.minutes=10080{quote}
> Describe of __consumer_offsets topic:
> {quote}Topic:__consumer_offsets	PartitionCount:20	ReplicationFactor:3	Configs:segment.bytes=104857600,cleanup.policy=compact
> 	Topic: __consumer_offsets	Partition: 0	Leader: 112	Replicas: 112,212,312	Isr: 212,312,112
> 	Topic: __consumer_offsets	Partition: 1	Leader: 212	Replicas: 212,312,412	Isr: 212,312,412
> 	Topic: __consumer_offsets	Partition: 2	Leader: 312	Replicas: 312,412,512	Isr: 312,412,512
> 	Topic: __consumer_offsets	Partition: 3	Leader: 412	Replicas: 412,512,112	Isr: 412,512,112
> 	Topic: __consumer_offsets	Partition: 4	Leader: 512	Replicas: 512,112,212	Isr: 512,212,112
> 	Topic: __consumer_offsets	Partition: 5	Leader: 112	Replicas: 112,312,412	Isr: 312,412,112
> 	Topic: __consumer_offsets	Partition: 6	Leader: 212	Replicas: 212,412,512	Isr: 212,412,512
> 	Topic: __consumer_offsets	Partition: 7	Leader: 312	Replicas: 312,512,112	Isr: 312,512,112
> 	Topic: __consumer_offsets	Partition: 8	Leader: 412	Replicas: 412,112,212	Isr: 412,212,112
> 	Topic: __consumer_offsets	Partition: 9	Leader: 512	Replicas: 512,212,312	Isr: 512,212,312
> 	Topic: __consumer_offsets	Partition: 10	Leader: 112	Replicas: 112,412,512	Isr: 412,512,112
> 	Topic: __consumer_offsets	Partition: 11	Leader: 212	Replicas: 212,512,112	Isr: 212,512,112
> 	Topic: __consumer_offsets	Partition: 12	Leader: 312	Replicas: 312,112,212	Isr: 312,212,112
> 	Topic: __consumer_offsets	Partition: 13	Leader: 412	Replicas: 412,212,312	Isr: 412,212,312
> 	Topic: __consumer_offsets	Partition: 14	Leader: 512	Replicas: 512,312,412	Isr: 512,312,412
> 	Topic: __consumer_offsets	Partition: 15	Leader: 112	Replicas: 112,512,212	Isr: 512,212,112
> 	Topic: __consumer_offsets	Partition: 16	Leader: 212	Replicas: 212,112,312	Isr: 212,312,112
> 	Topic: __consumer_offsets	Partition: 17	Leader: 312	Replicas: 312,212,412	Isr: 312,212,412
> 	Topic: __consumer_offsets	Partition: 18	Leader: 412	Replicas: 412,312,512	Isr: 412,312,512
> 	Topic: __consumer_offsets	Partition: 19	Leader: 512	Replicas: 512,412,112	Isr: 512,412,112{quote}
> OffsetManager logs:
> {quote}2015-04-29 17:58:43:403 CEST DEBUG [kafka-scheduler-3][kafka.server.OffsetManager]
Compacting offsets cache.
> 2015-04-29 17:58:43:403 CEST DEBUG [kafka-scheduler-3][kafka.server.OffsetManager] Found
1 stale offsets (older than 86400000 ms).
> 2015-04-29 17:58:43:404 CEST TRACE [kafka-scheduler-3][kafka.server.OffsetManager] Removing
stale offset and metadata for [drafts,tasks,1]: OffsetAndMetadata[824,consumer_id = drafts,
time = 1430322433,0]
> 2015-04-29 17:58:43:404 CEST TRACE [kafka-scheduler-3][kafka.server.OffsetManager] Marked
1 offsets in [__consumer_offsets,2] for deletion.
> 2015-04-29 17:58:43:404 CEST DEBUG [kafka-scheduler-3][kafka.server.OffsetManager] Removed
1 stale offsets in 1 milliseconds.{quote}
> Parameters are ignored and default values are used instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message