kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ismael Juma (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (KAFKA-2222) Write "Input/output error" did not result in broker shutdown
Date Sat, 28 Oct 2017 15:20:01 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-2222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ismael Juma resolved KAFKA-2222.
--------------------------------
    Resolution: Won't Fix

The code changed dramatically since this was filed (the stacktrace doesn't even apply any
more). Having said that, the underlying issue that we don't disable the disk or shutdown the
broker if there's an error during `sendfile` is probably still there. Not sure there's a reasonable
fix and if produce requests are happening, we will disable the disk (1.0.0 and later) or shutdown
the broker (before 1.0.0).

> Write "Input/output error" did not result in broker shutdown
> ------------------------------------------------------------
>
>                 Key: KAFKA-2222
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2222
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.8.1.2
>            Reporter: Jason Rosenberg
>
> We had a disk start failing intermittently, and began seeing errors like this in the
broker.  Usually, IOExceptions during a file write result in the broker shutting down immediately.
 This is with version 0.8.2.1.
> {code}
> 2015-05-21 23:59:57,841 ERROR [kafka-network-thread-27330-2] network.Processor - Closing
socket for /1.2.3.4 because of error
> java.io.IOException: Input/output error
>         at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
>         at sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:443)
>         at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:575)
>         at kafka.log.FileMessageSet.writeTo(FileMessageSet.scala:147)
>         at kafka.api.PartitionDataSend.writeTo(FetchResponse.scala:70)
>         at kafka.network.MultiSend.writeTo(Transmission.scala:101)
>         at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:125)
>         at kafka.network.MultiSend.writeTo(Transmission.scala:101)
>         at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
>         at kafka.network.Processor.write(SocketServer.scala:472)
>         at kafka.network.Processor.run(SocketServer.scala:342)
>         at java.lang.Thread.run(Thread.java:745)
> {code}
> This resulted in intermittent producer failures failing to send messages successfully,
etc.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message