Return-Path: X-Original-To: apmail-kafka-users-archive@www.apache.org Delivered-To: apmail-kafka-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CA726E2FE for ; Tue, 29 Jan 2013 16:05:30 +0000 (UTC) Received: (qmail 71402 invoked by uid 500); 29 Jan 2013 16:05:30 -0000 Delivered-To: apmail-kafka-users-archive@kafka.apache.org Received: (qmail 70813 invoked by uid 500); 29 Jan 2013 16:05:24 -0000 Mailing-List: contact users-help@kafka.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@kafka.apache.org Delivered-To: mailing list users@kafka.apache.org Received: (qmail 70772 invoked by uid 500); 29 Jan 2013 16:05:23 -0000 Delivered-To: apmail-incubator-kafka-users@incubator.apache.org Received: (qmail 70766 invoked by uid 99); 29 Jan 2013 16:05:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Jan 2013 16:05:22 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jay.kreps@gmail.com designates 209.85.215.45 as permitted sender) Received: from [209.85.215.45] (HELO mail-la0-f45.google.com) (209.85.215.45) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Jan 2013 16:05:16 +0000 Received: by mail-la0-f45.google.com with SMTP id er20so434559lab.32 for ; Tue, 29 Jan 2013 08:04:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:cc:content-type; bh=Vw7Al83cR9yd5v6EZTKqTwPHkntILavwuKbcd5e1YLw=; b=r1fJufoz8uR1v9fPtOhpiMXWcjNgqFQz700tWPf4Edtrcg7E6I7SYsVAU0+rKZyjdQ DVeVYNE7SsBZRmi38/NxQ7MBRIwnpHUm6LTRnq7BxsaXKO0DJHcfnfq8GxEqq2FVCxFY 7Z2DS6NKvZgiR0GFW0SfIzkOwn82hG63OeS2yR1+jgAR+2sSrbWmBtU3bry5vzVtPRmw N5LWpE02B31sYcKXqC4+ewEEjTdWY0/Yn1mwchmgeeHdeiJfZP/iQNkc6hyyDx4BCZPl 6K7sUlt2t9hyXv1aE2xCKlVLqDQcdokBcgYR4I2ZNFouf7t/KypBtb4IF+Hi6YUrMzhX qK5A== MIME-Version: 1.0 X-Received: by 10.112.82.202 with SMTP id k10mr719797lby.22.1359475494720; Tue, 29 Jan 2013 08:04:54 -0800 (PST) Received: by 10.114.37.36 with HTTP; Tue, 29 Jan 2013 08:04:54 -0800 (PST) In-Reply-To: References: Date: Tue, 29 Jan 2013 08:04:54 -0800 Message-ID: Subject: Re: Payload size exception From: Jay Kreps To: users@kafka.apache.org Cc: kafka-users@incubator.apache.org Content-Type: multipart/alternative; boundary=bcaec5555402f193d704d46f8d11 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec5555402f193d704d46f8d11 Content-Type: text/plain; charset=ISO-8859-1 There is a setting that controls the maximum message size. This is to ensure the messages can be read on the server and by all consumers without running out of memory or exceeding the consumer fetch size. In 0.7.x this setting is controlled by the broker configuration max.message.size. -Jay On Tue, Jan 29, 2013 at 12:18 AM, Bo Sun wrote: > hi all > i've got a exception . > kafka.common.MessageSizeTooLargeException: payload size of 1772597 larger > than 1000000 > at > > kafka.message.ByteBufferMessageSet.verifyMessageSize(ByteBufferMessageSet.scala:93) > at kafka.producer.SyncProducer.send(SyncProducer.scala:122) > at > > kafka.producer.ProducerPool$$anonfun$send$1.apply$mcVI$sp(ProducerPool.scala:114) > at > kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100) > at > kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:100) > at > > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57) > at > scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43) > at kafka.producer.ProducerPool.send(ProducerPool.scala:100) > at kafka.producer.Producer.zkSend(Producer.scala:140) > at kafka.producer.Producer.send(Producer.scala:99) > at kafka.javaapi.producer.Producer.send(Producer.scala:103) > > i dont know why. plz help me .thanks > --bcaec5555402f193d704d46f8d11--