ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Greg Senia (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (AMBARI-19790) HiveCLI and AtlasHook do not work correctly
Date Tue, 07 Mar 2017 20:50:38 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Greg Senia resolved AMBARI-19790.
---------------------------------
    Resolution: Won't Fix

> HiveCLI and AtlasHook do not work correctly
> -------------------------------------------
>
>                 Key: AMBARI-19790
>                 URL: https://issues.apache.org/jira/browse/AMBARI-19790
>             Project: Ambari
>          Issue Type: Bug
>         Environment: HDP 2.5.3.x
>            Reporter: Greg Senia
>
> After upgrading to HDP 2.5.3.x we are no longer able to correctly use the HiveCLI with
Atlas Hive Hook. Some assumptions specifically that the only access method is HiveServer2.

> We need the ability to split option in Ambari so HiveCLI AtlasHook uses the following
options:
> atlas.jaas.KafkaClient.loginModuleControlFlag=required
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
> atlas.jaas.KafkaClient.option.serviceName=kafka
> atlas.jaas.KafkaClient.option.renewTicket=True
> atlas.jaas.KafkaClient.option.useTicketCache=True
> and HiveServer2 using:
> atlas.jaas.KafkaClient.loginModuleControlFlag=required
> atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule
> atlas.jaas.KafkaClient.option.keyTab=/etc/security/keytabs/hive.service.keytab
> atlas.jaas.KafkaClient.option.principal=hive/_HOST@TECH.HDP.EXAMPLE.COM
> atlas.jaas.KafkaClient.option.serviceName=kafka
> atlas.jaas.KafkaClient.option.storeKey=True
> atlas.jaas.KafkaClient.option.useKeyTab=True
> If this is not done HiveCLI will fail to post to Kafka:
> ve/warehouse/nyse_stocks_test"}}}}}, endTime=Mon Jan 30 11:42:38 EST 2017}}]] after 3
retries. Quitting
> org.apache.kafka.common.KafkaException: Failed to construct kafka producer
>         at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335)
>         at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:188)
>         at org.apache.atlas.kafka.KafkaNotification.createProducer(KafkaNotification.java:311)
>         at org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:220)
>         at org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:84)
>         at org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:129)
>         at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:114)
>         at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:167)
>         at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:282)
>         at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
>         at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:193)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException:
Could not login: the client is being asked for a password, but the Kafka client code does
not currently support obtaining a password from the user. not available to garner  authentication
information from the user
>         at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86)
>         at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:71)
>         at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:83)
>         at org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277)
> After adjusting atlas-application.properties:
> -b558-4b02d509d888
> 2017-01-30 23:13:41,053 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148))
- <PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook from=org.apache.hadoop.hive.ql.Driver>
> 2017-01-30 23:13:41,062 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1485836021053 end=1485836021062
duration=9 from=org.apache.hadoop.hive.ql.Driver>
> 2017-01-30 23:13:41,062 INFO  [Atlas Logger 1]: hook.HiveHook (HiveHook.java:fireAndForget(209))
- Entered Atlas hook for hook type POST_EXEC_HOOK operation CREATETABLE_AS_SELECT
> 2017-01-30 23:13:41,062 INFO  [main]: ql.Driver (Driver.java:execute(1635)) - Resetting
the caller context to 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message