Return-Path: X-Original-To: apmail-zookeeper-user-archive@www.apache.org Delivered-To: apmail-zookeeper-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8F88B1814D for ; Mon, 19 Oct 2015 17:54:05 +0000 (UTC) Received: (qmail 67891 invoked by uid 500); 19 Oct 2015 17:53:41 -0000 Delivered-To: apmail-zookeeper-user-archive@zookeeper.apache.org Received: (qmail 67713 invoked by uid 500); 19 Oct 2015 17:53:36 -0000 Mailing-List: contact user-help@zookeeper.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@zookeeper.apache.org Delivered-To: mailing list user@zookeeper.apache.org Received: (qmail 67689 invoked by uid 99); 19 Oct 2015 17:53:35 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Oct 2015 17:53:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D7127C04B9 for ; Mon, 19 Oct 2015 17:53:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.006 X-Spam-Level: X-Spam-Status: No, score=0.006 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.008, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id jO4tqFANpjMC for ; Mon, 19 Oct 2015 17:53:33 +0000 (UTC) Received: from mail-lb0-f171.google.com (mail-lb0-f171.google.com [209.85.217.171]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 1B583429AA for ; Mon, 19 Oct 2015 17:53:33 +0000 (UTC) Received: by lbbpp2 with SMTP id pp2so122155560lbb.0 for ; Mon, 19 Oct 2015 10:53:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=BcYss6o6X5jvhtSR9swx8TAgPZyHZvv3NgqnD7MmBu8=; b=JvERZXfaVjjTK7UFrjJB6SoC8IqqriHR2GYmVvTPX/P8mE4KVlcwx+MliiCTLw0Bx6 b1wyrKYg6qyC34FwsHjFviECL+VEbi4Fs6ONcFRR2WB1HBthwlUbNxAQ9dyr+AoQBzIA ljac4D/7jJqY7qFI56m9U0/GQ0mlwXI0ehj26N2aoVYH/jdfDhn+ipqO3WppS3Cw8Dzc KfSc7mES1AEuE1jCiKMVz2ZSRKy1HJMFftd0o9+JfcTOCuMhtnuI+cqfdomdC2VnVEqc mSaB5tGX6hCO4v/sK0/AMbdcnHqBZagFjfaoCyFKP7XV2WWvPuOBR/cWeKoMdV8FjylU O1hg== X-Received: by 10.194.235.6 with SMTP id ui6mr40032362wjc.92.1445277211898; Mon, 19 Oct 2015 10:53:31 -0700 (PDT) Received: from [192.168.1.64] (host86-185-101-102.range86-185.btcentralplus.com. [86.185.101.102]) by smtp.gmail.com with ESMTPSA id i10sm41540137wjz.41.2015.10.19.10.53.31 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 19 Oct 2015 10:53:31 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Subject: Re: SASL issue with Zookeeper cluster From: Flavio Junqueira In-Reply-To: <982249125.2016061.1445255771866.JavaMail.yahoo@mail.yahoo.com> Date: Mon, 19 Oct 2015 18:53:29 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <9597007F-ED5A-45F9-AAB7-135AD97F2BF3@apache.org> References: <46D48CC7-D298-40F7-9CB2-D7E12353577A@apache.org> <982249125.2016061.1445255771866.JavaMail.yahoo@mail.yahoo.com> To: user@zookeeper.apache.org, sagar shukla X-Mailer: Apple Mail (2.2104) Cool! -Flavio > On 19 Oct 2015, at 12:56, sagar shukla = wrote: >=20 > Hi Flavio, > Setting up that parameter while executing MapReduce job helped get it = working without any issues. Thanks for your prompt responses :) >=20 > Regards,Sagar >=20 >=20 >=20 > On Monday, October 19, 2015 2:59 PM, Flavio Junqueira = wrote: >=20 >=20 > All I'm saying is that if the zk client finds the system property set, = it will think that you want to authenticate. You could also try setting = zookeeper.sasl.client to false. > -Flavio >=20 > On 19 Oct 2015, at 10:16, sagar shukla wrote: > Thanks for the prompt response. Since i am running MapReduce on hadoop = node, i feel i should use default jaas file, else my MapReduce auth = might break ... right? > Exception indicates issue at zookeeper side. > I tried with non-secure hadoop cluster which works as expected. > Regards,Sagar >=20 > Sent from Yahoo Mail on Android=20 >=20 > On Mon, 19 Oct, 2015 at 2:33 pm, Flavio Junqueira = wrote: Do you have the jaas config property set which is causing your = client to believe you want to authenticate? You may also want to ask = that same question on the Kafka list. >=20 > -Flavio >=20 >> On 19 Oct 2015, at 09:56, sagar shukla = wrote: >>=20 >> Hi All, >> I have a zookeeper cluster configured with Kafka without any SASL = security configuration. Also I have a hadoop cluster configured with = security which uses a different zookeeper cluster. So overall, I have = two zookeeper clusters - one with security and one without security. >>=20 >> Now when I try to run a mapreduce program to fetch data from Kafka = using non-secure zookeeper, I get following error message of SASL though = my read zookeeper cluster does not have security configured. >> : org.I0Itec.zkclient.exception.ZkException: = org.apache.zookeeper.KeeperException$AuthFailedException: = KeeperErrorCode =3D AuthFailed for = /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 >> at = org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:68) >> at = org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685) >> at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304) >> at = org.I0Itec.zkclient.ZkClient.createEphemeral(ZkClient.java:328) >> at = kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:222) >> at = kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:237) >> at = kafka.utils.ZkUtils$.createEphemeralPathExpectConflictHandleZKBug(ZkUtils.= scala:275) >> at = kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumer= Connector$$registerConsumerInZK(ZookeeperConsumerConnector.scala:254) >> at = kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnect= or.scala:239) >> at = kafka.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperCo= nsumerConnector.scala:153) >> at = org.apache.spark.streaming.kafka.KafkaReceiver.onStart(KafkaInputDStream.s= cala:111) >> at = org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(Recei= verSupervisor.scala:125) >> at = org.apache.spark.streaming.receiver.ReceiverSupervisor.start(ReceiverSuper= visor.scala:109) >> at = org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$ano= nfun$8.apply(ReceiverTracker.scala:308) >> at = org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$ano= nfun$8.apply(ReceiverTracker.scala:300) >> at = org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1= 767) >> at = org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1= 767) >> at = org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63) >> at org.apache.spark.scheduler.Task.run(Task.scala:70) >> at = org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213) >> at = java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1145) >> at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :615) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: = KeeperErrorCode =3D AuthFailed for = /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 >> at = org.apache.zookeeper.KeeperException.create(KeeperException.java:123) >> at = org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) >> at = org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87) >> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308) >> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304) >> at = org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) >> ... 21 more >>=20 >> I did try setting up parameter -Djava.security.auth.login.config=3Dnone= while trying to run the mapreduce program. >>=20 >> Any thoughts on how I can get rid of this security warning? >> Regards,Sagar >>=20 >=20 >=20 >=20 >=20 >=20