kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Binary Data and Kafka
Date Wed, 08 May 2013 15:25:56 GMT
No. Kafka broker stores the binary data as it is. The binary data may be
compressed, if compression is enabled at the producer.

Thanks,

Jun


On Wed, May 8, 2013 at 5:57 AM, Sybrandy, Casey <
Casey.Sybrandy@six3systems.com> wrote:

> All,
>
> Does the Kafka broker Base64 encode the messages?  We are sending binary
> data to the brokers and I looked at the logs to confirm that they data was
> being stored, however all of the data, with a few exceptions, looks to be
> Base64 encoded.  I didn't expect this, so I wanted to ask and confirm what
> I'm seeing.
>
> If this is true, does this affect the size of the message when fetching?
>  In other words, if I send a 100K message, do I have to make sure I can
> fetch a 300K message since the message can now be 300K in size because of
> the encoding?
>
> Casey Sybrandy MSWE
> Six3Systems
> Cyber and Enterprise Systems Group
> www.six3systems.com
> 301-206-6000 (Office)
> 301-206-6020 (Fax)
> 11820 West Market Place
> Suites N-P
> Fulton, MD. 20759
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message