hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hongyuan Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not used
Date Sat, 08 Jul 2017 07:44:02 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hongyuan Li updated HADOOP-14623:
---------------------------------
    Description: 
{{KafkaSink}}#{{init}}  should set ack to *1* to make sure the message has been written to
the broker at least.

current code list below:

{code}
  
    props.put("request.required.acks", "0");

{code}

*Update*

find another bug about this class, {{key.serializer}} used {{org.apache.kafka.common.serialization.ByteArraySerializer}},
however, the key properties of Producer is Integer, codes list below:
{code}
    props.put("key.serializer",
        "org.apache.kafka.common.serialization.ByteArraySerializer");
……………
 producer = new KafkaProducer<Integer, byte[]>(props);
{code}

  was:
{{KafkaSink}}#{{init}}  should set ack to *1* to make sure the message has been written to
the broker at least.

current code list below:

{code}
  
    props.put("request.required.acks", "0");

{code}

*Update*

find another bug about this class, key.serializer used {{org.apache.kafka.common.serialization.ByteArraySerializer}}


> KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not
used
> ------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-14623
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14623
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: common, tools
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Hongyuan Li
>            Assignee: Hongyuan Li
>         Attachments: HADOOP-14623-001.patch
>
>
> {{KafkaSink}}#{{init}}  should set ack to *1* to make sure the message has been written
to the broker at least.
> current code list below:
> {code}
>   
>     props.put("request.required.acks", "0");
> {code}
> *Update*
> find another bug about this class, {{key.serializer}} used {{org.apache.kafka.common.serialization.ByteArraySerializer}},
however, the key properties of Producer is Integer, codes list below:
> {code}
>     props.put("key.serializer",
>         "org.apache.kafka.common.serialization.ByteArraySerializer");
> ……………
>  producer = new KafkaProducer<Integer, byte[]>(props);
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message