zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sagar shukla <sa_shu...@yahoo.com.INVALID>
Subject Re: SASL issue with Zookeeper cluster
Date Mon, 19 Oct 2015 11:56:11 GMT
Hi Flavio,
Setting up that parameter while executing MapReduce job helped get it working without any
issues. Thanks for your prompt responses :)


     On Monday, October 19, 2015 2:59 PM, Flavio Junqueira <fpj@apache.org> wrote:

 All I'm saying is that if the zk client finds the system property set, it will think that
you want to authenticate. You could also try setting zookeeper.sasl.client to false.

On 19 Oct 2015, at 10:16, sagar shukla <sa_shukla@yahoo.com> wrote:
Thanks for the prompt response. Since i am running MapReduce on hadoop node, i feel i should
use default jaas file, else my MapReduce auth might break ... right?
Exception indicates issue at zookeeper side.
I tried with non-secure hadoop cluster which works as expected.

Sent from Yahoo Mail on Android 
 On Mon, 19 Oct, 2015 at 2:33 pm, Flavio Junqueira<fpj@apache.org> wrote:  Do you have
the jaas config property set which is causing your client to believe you want to authenticate?
You may also want to ask that same question on the Kafka list.


> On 19 Oct 2015, at 09:56, sagar shukla <sa_shukla@yahoo.com.INVALID> wrote:
> Hi All,
> I have a zookeeper cluster configured with Kafka without any SASL security configuration.
Also I have a hadoop cluster configured with security which uses a different zookeeper cluster.
So overall, I have two zookeeper clusters - one with security and one without security.
> Now when I try to run a mapreduce program to fetch data from Kafka using non-secure zookeeper,
I get following error message of SASL though my read zookeeper cluster does not have security
> : org.I0Itec.zkclient.exception.ZkException: org.apache.zookeeper.KeeperException$AuthFailedException:
KeeperErrorCode = AuthFailed for /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826
>        at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:68)
>        at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
>        at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
>        at org.I0Itec.zkclient.ZkClient.createEphemeral(ZkClient.java:328)
>        at kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:222)
>        at kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:237)
>        at kafka.utils.ZkUtils$.createEphemeralPathExpectConflictHandleZKBug(ZkUtils.scala:275)
>        at kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$registerConsumerInZK(ZookeeperConsumerConnector.scala:254)
>        at kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnector.scala:239)
>        at kafka.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:153)
>        at org.apache.spark.streaming.kafka.KafkaReceiver.onStart(KafkaInputDStream.scala:111)
>        at org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(ReceiverSupervisor.scala:125)
>        at org.apache.spark.streaming.receiver.ReceiverSupervisor.start(ReceiverSupervisor.scala:109)
>        at org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:308)
>        at org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:300)
>        at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
>        at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767)
>        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63)
>        at org.apache.spark.scheduler.Task.run(Task.scala:70)
>        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode
= AuthFailed for /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826
>        at org.apache.zookeeper.KeeperException.create(KeeperException.java:123)
>        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>        at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
>        at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
>        at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
>        at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
>        at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
>        ... 21 more
> I did try setting up parameter -Djava.security.auth.login.config=none while trying to
run the mapreduce program.
> Any thoughts on how I can get rid of this security warning?
> Regards,Sagar

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message