Mailing-List: contact general-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: general@lucene.apache.org
From: "Manjunath N S (mans3)" <mans3@cisco.com>
To: "general@lucene.apache.org" <general@lucene.apache.org>,
        "dev@lucene.apache.org" <dev@lucene.apache.org>
Subject: Solr Zookeeper error while connecting from Spark context
Thread-Topic: Solr Zookeeper error while connecting from Spark context
Thread-Index: AdKNiw7tqfm1UiPaShKoAgIMJTT9Yg==
Date: Thu, 23 Feb 2017 04:17:18 +0000
Message-ID: <479ad426a2aa4c3cb23753fdc1e5ea76@XCH-RTP-012.cisco.com>
Accept-Language: en-GB, en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_479ad426a2aa4c3cb23753fdc1e5ea76XCHRTP012ciscocom_"
MIME-Version: 1.0
archived-at: Thu, 23 Feb 2017 04:17:57 -0000

--_000_479ad426a2aa4c3cb23753fdc1e5ea76XCHRTP012ciscocom_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hello,
I have been trying to read hive tables by invoking HiveContext within Spark=
Context.
The data is being read from hive tables,However when I try to connect it to=
 Solr external zookeeper server from Hadoop edge node,I am facing an issue.

The same code works when I try to push sample json from SparkContext to Sol=
r using same zookeeper server.I am using lucidworks spark-solr:2.1.0 packag=
e to do this. End goal is to push parquet files to Solr directly.

Please find the error below.

17/02/22 20:14:17 ERROR ZooKeeperSaslClient: SASL authentication failed usi=
ng login context 'Client'.
17/02/22 20:14:17 WARN ConnectionManager: zkClient received AuthFailed
17/02/22 20:14:17 WARN SolrQuerySupport: Can't get uniqueKey for testspark =
due to: com.google.common.util.concurrent.UncheckedExecutionException: org.=
apache.solr.common.cloud.ZooKeeperException:
17/02/22 20:14:17 ERROR ZooKeeperSaslClient: SASL authentication failed usi=
ng login context 'Client'.
17/02/22 20:14:17 WARN ConnectionManager: zkClient received AuthFailed
Exception in thread "main" com.google.common.util.concurrent.UncheckedExecu=
tionException: org.apache.solr.common.cloud.ZooKeeperException:
        at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2=
263)
        at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
        at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:400=
4)
        at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCa=
che.java:4874)
        at com.lucidworks.spark.util.SolrSupport$.getCachedCloudClient(Solr=
Support.scala:93)
        at com.lucidworks.spark.util.SolrSupport$.getSolrBaseUrl(SolrSuppor=
t.scala:97)
        at com.lucidworks.spark.util.SolrRelationUtil$.getBaseSchema(SolrRe=
lationUtil.scala:34)
        at com.lucidworks.spark.SolrRelation.<init>(SolrRelation.scala:83)
        at solr.DefaultSource.createRelation(DefaultSource.scala:26)
        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.a=
pply(ResolvedDataSource.scala:222)
        at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:=
148)
        at com.cisco.SparkSolr.main(SparkSolr.java:58)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessor=
Impl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethod=
AccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$Spa=
rkSubmit$$runMain(SparkSubmit.scala:742)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.sca=
la:181)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:20=
6)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
        at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudS=
olrClient.java:475)
        at com.lucidworks.spark.util.SolrSupport$.getSolrCloudClient(SolrSu=
pport.scala:83)
        at com.lucidworks.spark.util.SolrSupport$.getNewSolrCloudClient(Sol=
rSupport.scala:89)
        at com.lucidworks.spark.util.CacheSolrClient$$anon$1.load(SolrSuppo=
rt.scala:38)
        at com.lucidworks.spark.util.CacheSolrClient$$anon$1.load(SolrSuppo=
rt.scala:36)
        at com.google.common.cache.LocalCache$LoadingValueReference.loadFut=
ure(LocalCache.java:3599)
        at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.j=
ava:2379)
        at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(Local=
Cache.java:2342)
       at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:22=
57)
        ... 20 more
Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: Keeper=
ErrorCode =3D AuthFailed for /clusterstate.json
        at org.apache.zookeeper.KeeperException.create(KeeperException.java=
:123)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java=
:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
        at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient=
.java:311)
        at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient=
.java:308)
        at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdE=
xecutor.java:60)
        at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.ja=
va:308)
        at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWat=
chersAndUpdate(ZkStateReader.java:289)
        at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudS=
olrClient.java:467)
        ... 28 more
hdsvmg@hddev-c01-edge-01:/users/hdsvmg>

--_000_479ad426a2aa4c3cb23753fdc1e5ea76XCHRTP012ciscocom_--