kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Todd Lipcon <t...@cloudera.com>
Subject Re: Kudu client close exception
Date Mon, 19 Mar 2018 19:13:13 GMT
Hi,

Is the warning that you pasted actually getting thrown as an exception? Or
just being logged to the console?

If it's possible, you might try updating to the most recent release
candidate client from Kudu 1.7. It contains a number of bug fixes for the
Java client and also improves error reporting a lot so could make
troubleshooting much easier. You can find the Kudu 1.7.0rc2 artifacts that
we're currently voting on here:

https://repository.apache.org/content/repositories/orgapachekudu-1019/

If you're able to test it out and report back that would also be nice to
report on the dev@ mailing list VOTE thread.

-Todd


On Sun, Mar 18, 2018 at 11:55 PM, Dun Rainer <rainerdun@live.cn> wrote:

> Hi:
>
>   I use kudu api in spark application ,after a few hours of running.  An
> exception occurs when close kudu client. my kudu version is 1.3.1 and spark
> is 2.2.1.
>
>    init kudu  code :
>       val client= new KuduClient.KuduClientBuilder(env.masterURL)
>   .defaultSocketReadTimeoutMs(DEFAULT_SLEEP)
>   .defaultOperationTimeoutMs(DEFAULT_SLEEP)
>   .build
>
>       var session = client.newSession()
>    session.setFlushMode(SessionConfiguration.FlushMode.AUTO_FLUSH_
> BACKGROUND)
>    session.setMutationBufferSpace(_MUTU_BUFFER_SIZE)
>    session.setFlushInterval(_FLUSH_INTERVAL)
>    session.setIgnoreAllDuplicateRows(ignoreDuplicateRows)
>
>  Close kudu client code:
>
>   if (client != null) {
>      client.shutdown()
>    }
>
>
>
>  Exception message :
>     WARN client.ConnectToCluster: Error receiving a response from:
> bi-hd24:7051
>
> org.apache.kudu.client.RecoverableException: [Peer master-bi-hd24:7051] Connection closed
> 	at org.apache.kudu.client.TabletClient.cleanup(TabletClient.java:655)
> 	at org.apache.kudu.client.TabletClient.channelClosed(TabletClient.java:615)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
> 	at org.apache.kudu.client.TabletClient.handleUpstream(TabletClient.java:601)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.channelClosed(ReadTimeoutHandler.java:176)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:60)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:493)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.handler.codec.frame.FrameDecoder.channelClosed(FrameDecoder.java:371)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireChannelClosed(Channels.java:468)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels$6.run(Channels.java:457)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
> 	at org.apache.kudu.client.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
>
>
>
> Thanks
>
> Rainerdun
>
>
>
>
>



-- 
Todd Lipcon
Software Engineer, Cloudera

Mime
View raw message