kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mac Noland <mcdonaldnol...@gmail.com>
Subject Re: Problems connecting form Spark
Date Mon, 05 Mar 2018 16:14:06 GMT
Any chance you can try spark2-shell with Kudu 1.6 and then re-try your
tests?

spark-shell --packages org.apache.kudu:kudu-spark2_2.11:1.6.0

On Fri, Mar 2, 2018 at 5:02 AM, Saúl Nogueras <susensio@gmail.com> wrote:

> I cannot properly connect to Kudu from Spark, error says “Kudu master has
> no leader”
>
>    - CDH 5.14
>    - Kudu 1.6
>    - Spark 1.6.0 standalone and 2.2.0
>
> When I use Impala in HUE to create and query kudu tables, it works
> flawlessly.
>
> However, connecting from Spark throws some errors I cannot decipher.
>
> I have tried using both pyspark and spark-shell. With spark shell I had to
> use spark 1.6 instead of 2.2 because some maven dependencies problems, that
> I have localized but not been able to fix. More info here.
> ------------------------------
> Case 1: using pyspark2 (Spark 2.2.0)
>
> $ pyspark2 --master yarn --jars /opt/cloudera/parcels/CDH-5.14.0-1.cdh5.14.0.p0.24/lib/kudu/kudu-spark2_2.11.jar
>
> > df = sqlContext.read.format('org.apache.kudu.spark.kudu').options(**{"kudu.master":"172.17.0.43:7077",
"kudu.table":"impala::default.test"}).load()
>
> 18/03/02 10:23:27 WARN client.ConnectToCluster: Error receiving response from 172.17.0.43:7077
> org.apache.kudu.client.RecoverableException: [peer master-172.17.0.43:7077] encountered
a read timeout; closing the channel
>         at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:412)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
>         at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.exceptionCaught(SimpleChannelUpstreamHandler.java:153)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.Channels.fireExceptionCaught(Channels.java:536)
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.readTimedOut(ReadTimeoutHandler.java:236)
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler$ReadTimeoutTask$1.run(ReadTimeoutHandler.java:276)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
>         at org.apache.kudu.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
>         at org.apache.kudu.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutException
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.<clinit>(ReadTimeoutHandler.java:84)
>         at org.apache.kudu.client.Connection$ConnectionPipeline.init(Connection.java:782)
>         at org.apache.kudu.client.Connection.<init>(Connection.java:199)
>         at org.apache.kudu.client.ConnectionCache.getConnection(ConnectionCache.java:133)
>         at org.apache.kudu.client.AsyncKuduClient.newRpcProxy(AsyncKuduClient.java:248)
>         at org.apache.kudu.client.AsyncKuduClient.newMasterRpcProxy(AsyncKuduClient.java:272)
>         at org.apache.kudu.client.ConnectToCluster.run(ConnectToCluster.java:157)
>         at org.apache.kudu.client.AsyncKuduClient.getMasterTableLocationsPB(AsyncKuduClient.java:1350)
>         at org.apache.kudu.client.AsyncKuduClient.exportAuthenticationCredentials(AsyncKuduClient.java:651)
>         at org.apache.kudu.client.KuduClient.exportAuthenticationCredentials(KuduClient.java:293)
>         at org.apache.kudu.spark.kudu.KuduContext$$anon$1.run(KuduContext.scala:97)
>         at org.apache.kudu.spark.kudu.KuduContext$$anon$1.run(KuduContext.scala:96)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:360)
>         at org.apache.kudu.spark.kudu.KuduContext.<init>(KuduContext.scala:96)
>         at org.apache.kudu.spark.kudu.KuduRelation.<init>(DefaultSource.scala:162)
>         at org.apache.kudu.spark.kudu.DefaultSource.createRelation(DefaultSource.scala:75)
>         at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:306)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:178)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:146)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
>         at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
>         at py4j.Gateway.invoke(Gateway.java:280)
>         at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
>         at py4j.commands.CallCommand.execute(CallCommand.java:79)
>         at py4j.GatewayConnection.run(GatewayConnection.java:214)
>         ... 1 more
> 18/03/02 10:23:27 WARN client.ConnectToCluster: Unable to find the leader master 172.17.0.43:7077;
will retry
>
> Py4JJavaError                             Traceback (most recent call last)
> <ipython-input-1-e1dfaec7a544> in <module>()
> ----> 1 df = sqlContext.read.format('org.apache.kudu.spark.kudu').options(**{"kudu.master":"172.17.0.43:7077",
"kudu.table":"impala::default.logika_dataset_kudu"}).load()
>
> /opt/cloudera/parcels/SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/lib/spark2/python/pyspark/sql/readwriter.py
in load(self, path, format, schema, **options)
>     163             return self._df(self._jreader.load(self._spark._sc._jvm.PythonUtils.toSeq(path)))
>     164         else:
> --> 165             return self._df(self._jreader.load())
>     166
>     167     @since(1.4)
>
> /opt/cloudera/parcels/SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/lib/spark2/python/lib/py4j-0.10.4-src.zip/py4j/java_gateway.py
in __call__(self, *args)
>    1131         answer = self.gateway_client.send_command(command)
>    1132         return_value = get_return_value(
> -> 1133             answer, self.gateway_client, self.target_id, self.name)
>    1134
>    1135         for temp_arg in temp_args:
>
> /opt/cloudera/parcels/SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/lib/spark2/python/pyspark/sql/utils.py
in deco(*a, **kw)
>      61     def deco(*a, **kw):
>      62         try:
> ---> 63             return f(*a, **kw)
>      64         except py4j.protocol.Py4JJavaError as e:
>      65             s = e.java_exception.toString()
>
> /opt/cloudera/parcels/SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/lib/spark2/python/lib/py4j-0.10.4-src.zip/py4j/protocol.py
in get_return_value(answer, gateway_client, target_id, name)
>     317                 raise Py4JJavaError(
>     318                     "An error occurred while calling {0}{1}{2}.\n".
> --> 319                     format(target_id, ".", name), value)
>     320             else:
>     321                 raise Py4JError(
>
> Py4JJavaError: An error occurred while calling o59.load.
> : java.security.PrivilegedActionException: org.apache.kudu.client.NoLeaderFoundException:
Master config (172.17.0.43:7077) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException:
[peer master-172.17.0.43:7077] encountered a read timeout; closing the channel
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:360)
>         at org.apache.kudu.spark.kudu.KuduContext.<init>(KuduContext.scala:96)
>         at org.apache.kudu.spark.kudu.KuduRelation.<init>(DefaultSource.scala:162)
>         at org.apache.kudu.spark.kudu.DefaultSource.createRelation(DefaultSource.scala:75)
>         at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:306)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:178)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:146)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
>         at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
>         at py4j.Gateway.invoke(Gateway.java:280)
>         at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
>         at py4j.commands.CallCommand.execute(CallCommand.java:79)
>         at py4j.GatewayConnection.run(GatewayConnection.java:214)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (172.17.0.43:7077)
has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [peer master-172.17.0.43:7077]
encountered a read timeout; closing the channel
>         at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:272)
>         at org.apache.kudu.client.ConnectToCluster.access$100(ConnectToCluster.java:49)
>         at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:349)
>         at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:338)
>         at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
>         at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
>         at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
>         at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
>         at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
>         at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
>         at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:238)
>         at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:292)
>         at org.apache.kudu.client.RpcProxy.failOrRetryRpc(RpcProxy.java:388)
>         at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:217)
>         at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:60)
>         at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:132)
>         at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:128)
>         at org.apache.kudu.client.Connection.cleanup(Connection.java:694)
>         at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:439)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
>         at org.apache.kudu.client.Connection.handleUpstream(Connection.java:239)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.exceptionCaught(SimpleChannelUpstreamHandler.java:153)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.Channels.fireExceptionCaught(Channels.java:536)
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.readTimedOut(ReadTimeoutHandler.java:236)
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler$ReadTimeoutTask$1.run(ReadTimeoutHandler.java:276)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
>         at org.apache.kudu.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
>         at org.apache.kudu.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
>         at org.apache.kudu.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         ... 1 more
> Caused by: org.apache.kudu.client.RecoverableException: [peer master-172.17.0.43:7077]
encountered a read timeout; closing the channel
>         at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:412)
>         ... 21 more
> Caused by: org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutException
>         at org.apache.kudu.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.<clinit>(ReadTimeoutHandler.java:84)
>         at org.apache.kudu.client.Connection$ConnectionPipeline.init(Connection.java:782)
>         at org.apache.kudu.client.Connection.<init>(Connection.java:199)
>         at org.apache.kudu.client.ConnectionCache.getConnection(ConnectionCache.java:133)
>         at org.apache.kudu.client.AsyncKuduClient.newRpcProxy(AsyncKuduClient.java:248)
>         at org.apache.kudu.client.AsyncKuduClient.newMasterRpcProxy(AsyncKuduClient.java:272)
>         at org.apache.kudu.client.ConnectToCluster.run(ConnectToCluster.java:157)
>         at org.apache.kudu.client.AsyncKuduClient.getMasterTableLocationsPB(AsyncKuduClient.java:1350)
>         at org.apache.kudu.client.AsyncKuduClient.exportAuthenticationCredentials(AsyncKuduClient.java:651)
>         at org.apache.kudu.client.KuduClient.exportAuthenticationCredentials(KuduClient.java:293)
>         at org.apache.kudu.spark.kudu.KuduContext$$anon$1.run(KuduContext.scala:97)
>         at org.apache.kudu.spark.kudu.KuduContext$$anon$1.run(KuduContext.scala:96)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:360)
>         at org.apache.kudu.spark.kudu.KuduContext.<init>(KuduContext.scala:96)
>         at org.apache.kudu.spark.kudu.KuduRelation.<init>(DefaultSource.scala:162)
>         at org.apache.kudu.spark.kudu.DefaultSource.createRelation(DefaultSource.scala:75)
>         at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:306)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:178)
>         at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:146)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
>         at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
>         at py4j.Gateway.invoke(Gateway.java:280)
>         at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
>         at py4j.commands.CallCommand.execute(CallCommand.java:79)
>         at py4j.GatewayConnection.run(GatewayConnection.java:214)
>         ... 1 more
>
> Case 2: using spark-shell (Spark 1.6.0 standalone):
>
> $ spark-shell --master spark://localhost:7077 --packages org.apache.kudu:kudu-spark_2.10:1.1.0
> > import org.apache.kudu.spark.kudu._
> > import org.apache.kudu.client._
> > import collection.JavaConverters._
> > val df = sqlContext.read.options(Map("kudu.master" -> "localhost:7051","kudu.table"
-> "impala::default.test")).kudu
> df: org.apache.spark.sql.DataFrame = [dataset: string, id: string, itemnumber: string,
srcid: string, timestamp: string, year: string, month: string, day: string, week: string,
quarter: string, season: string, city: string, region1: string, region2: string, region3:
string, region4: string, locality: string, itemname: string, itembqu: string, product_category:
string, amount: string, mapped_zipcode: string, latitude: string, longitude: string, depositor_code:
string, depositor_name: string, customer_code: string, is_island: string]
>
> It seems to be connecting, as it is able to show the column names, but if I
>
> // register a temporary table and use SQL
> df.registerTempTable("test")
> val filteredDF = sqlContext.sql("select count(*) from test").show()
>
> bang!
>
> [Stage 0:>                                                          (0 + 6) / 6]
> Lost task 1.0 in stage 0.0 (TID 1, tt-slave-2.novalocal, executor 1): org.apache.kudu.client.NonRecoverableException:
RPC can not complete before timeout: KuduRpc(method=GetTableSchema, tablet=null, attempt=30,
DeadlineTracker(timeout=30000, elapsed=27307), Traces:
>
> [0ms] querying master,
> [48ms] Sub rpc: GetMasterRegistration sending RPC to server Kudu Master - localhost:7051,
> [71ms] Sub rpc: GetMasterRegistration received from server Kudu Master - localhost:7051
response
> Network error:
> [Peer Kudu Master - localhost:7051] Connection reset,
> [75ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has no
leader.
> Exceptions received: org.apache.kudu.client.RecoverableException:
> [Peer Kudu Master - localhost:7051] Connection reset,
>
> ...
> (SAME MESSAGE REPEATS 25 TIMES)
> ...
>
> [24262ms] querying master,
> [24262ms] Sub rpc: GetMasterRegistration sending RPC to server Kudu Master - localhost:7051,
> [24263ms] Sub rpc: GetMasterRegistration received from server Kudu Master - localhost:7051
response
> Network error:
> [Peer Kudu Master - localhost:7051] Connection reset,
> [24263ms] delaying RPC due to Service unavailable: Master config (localhost:7051) has
no leader.
> Exceptions received: org.apache.kudu.client.RecoverableException:
> [Peer Kudu Master - localhost:7051] Connection reset,
> [24661ms] trace too long, truncated)
>
>         at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:961)
>         at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:1203)
>         at org.apache.kudu.client.AsyncKuduClient.access$800(AsyncKuduClient.java:110)
>         at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:764)
>         at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:754)
>         at com.stumbleupon.async.Deferred.doCall(Deferred.java:1278)
>         at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1257)
>         at com.stumbleupon.async.Deferred.callback(Deferred.java:1005)
>         at org.apache.kudu.client.GetMasterRegistrationReceived.incrementCountAndCheckExhausted(GetMasterRegistrationReceived.java:156)
>         at org.apache.kudu.client.GetMasterRegistrationReceived.access$300(GetMasterRegistrationReceived.java:45)
>         at org.apache.kudu.client.GetMasterRegistrationReceived$GetMasterRegistrationErrCB.call(GetMasterRegistrationReceived.java:236)
>         at org.apache.kudu.client.GetMasterRegistrationReceived$GetMasterRegistrationErrCB.call(GetMasterRegistrationReceived.java:225)
>         at com.stumbleupon.async.Deferred.doCall(Deferred.java:1278)
>         at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1257)
>         at com.stumbleupon.async.Deferred.callback(Deferred.java:1005)
>         at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:220)
>         at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:274)
>         at org.apache.kudu.client.TabletClient.failOrRetryRpc(TabletClient.java:770)
>         at org.apache.kudu.client.TabletClient.failOrRetryRpcs(TabletClient.java:747)
>         at org.apache.kudu.client.TabletClient.cleanup(TabletClient.java:736)
>         at org.apache.kudu.client.TabletClient.channelClosed(TabletClient.java:698)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
>         at org.apache.kudu.client.TabletClient.handleUpstream(TabletClient.java:679)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.apache.kudu.client.shaded.org.jboss.netty.handler.timeout.ReadTimeoutHandler.channelClosed(ReadTimeoutHandler.java:176)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:88)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels.fireChannelClosed(Channels.java:468)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.Channels$6.run(Channels.java:457)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.ChannelRunnableWrapper.run(ChannelRunnableWrapper.java:40)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.processTaskQueue(AbstractNioSelector.java:391)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:315)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
>         at org.apache.kudu.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
>         at org.apache.kudu.client.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
>         at org.apache.kudu.client.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (localhost:7051)
has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: [Peer Kudu
Master - localhost:7051] Connection reset
>         at org.apache.kudu.client.GetMasterRegistrationReceived.incrementCountAndCheckExhausted(GetMasterRegistrationReceived.java:154)
>         ... 32 more
> Caused by: org.apache.kudu.client.RecoverableException: [Peer Kudu Master - localhost:7051]
Connection reset
>         at org.apache.kudu.client.TabletClient.cleanup(TabletClient.java:734)
>         ... 21 more
>
> As I said, Kudu service is up an running, and I am able to query kudu
> tables from Hue using Impala.
>
> What am I missing here? Is this the right approach to interfacing Spark
> with Kudu?
>
> Thanks
> ​
>

Mime
View raw message