From dev-return-22686-archive-asf-public=cust-asf.ponee.io@atlas.apache.org Mon Apr 23 10:58:07 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id CFE43180676 for ; Mon, 23 Apr 2018 10:58:06 +0200 (CEST) Received: (qmail 33084 invoked by uid 500); 23 Apr 2018 08:58:04 -0000 Mailing-List: contact dev-help@atlas.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.apache.org Delivered-To: mailing list dev@atlas.apache.org Received: (qmail 32637 invoked by uid 99); 23 Apr 2018 08:58:04 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Apr 2018 08:58:04 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id C3F1D18035D for ; Mon, 23 Apr 2018 08:58:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -109.511 X-Spam-Level: X-Spam-Status: No, score=-109.511 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, KAM_ASCII_DIVIDERS=0.8, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id MAkiT3vRFpJm for ; Mon, 23 Apr 2018 08:58:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 161A55F27D for ; Mon, 23 Apr 2018 08:58:02 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 32B0CE0CA5 for ; Mon, 23 Apr 2018 08:58:01 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 82645241CB for ; Mon, 23 Apr 2018 08:58:00 +0000 (UTC) Date: Mon, 23 Apr 2018 08:58:00 +0000 (UTC) From: "Ruchi Solani (JIRA)" To: dev@atlas.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Assigned] (ATLAS-2592) Storm atlas hook fails with NPE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ATLAS-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruchi Solani reassigned ATLAS-2592: ----------------------------------- Assignee: Ruchi Solani > Storm atlas hook fails with NPE > ------------------------------- > > Key: ATLAS-2592 > URL: https://issues.apache.org/jira/browse/ATLAS-2592 > Project: Atlas > Issue Type: Bug > Reporter: Ruchi Solani > Assignee: Ruchi Solani > Priority: Blocker > > Here is the output of submission request: > {code} > 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka consumer property 'auto.offset.reset' to 'earliest' to ensure at-least-once processing (KafkaSpoutConfig:761) > 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka consumer property 'enable.auto.commit' to 'false', because the spout does not support auto-commit (KafkaSpoutConfig:775) > 2018-04-13 07:34:04,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION new 1.2.1.3.0.0.0-1189 old null (Utils:2286) > 2018-04-13 07:34:04,252 INFO - [TestNGInvoker-testRetry():[]] ~ Generated ZooKeeper secret payload for MD5-digest: -7659255060620243743:-5999822419551893831 (StormSubmitter:87) > 2018-04-13 07:34:04,266 INFO - [TestNGInvoker-testRetry():[]] ~ successfully logged in. (Login:300) > 2018-04-13 07:34:04,278 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627 (NimbusClient:96) > 2018-04-13 07:34:04,288 INFO - [TestNGInvoker-testRetry():[]] ~ Got AutoCreds [] (AuthUtils:208) > 2018-04-13 07:34:04,289 INFO - [TestNGInvoker-testRetry():[]] ~ successfully logged in. (Login:300) > 2018-04-13 07:34:04,300 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627 (NimbusClient:96) > 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading dependencies - jars... (StormSubmitter:280) > 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading dependencies - artifacts... (StormSubmitter:295) > 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Dependency Blob keys - jars : [] / artifacts : [] (StormSubmitter:310) > 2018-04-13 07:34:04,306 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading topology jar /hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar to assigned location: /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar (StormSubmitter:475) > Start uploading file '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar' to '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' (295334349 bytes) > [ ] 307200 / 295334349 > ... > [==================================================] 295334349 / 295334349 > [==================================================] 295334349 / 295334349 > File '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar' uploaded to '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar' (295334349 bytes) > 2018-04-13 07:34:07,245 INFO - [TestNGInvoker-testRetry():[]] ~ Successfully uploaded topology jar to assigned location: /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar (StormSubmitter:500) > 2018-04-13 07:34:07,246 INFO - [TestNGInvoker-testRetry():[]] ~ Submitting topology SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE in distributed mode with conf \{"java.security.auth.login.config":"\/etc\/storm\/conf\/client_jaas.conf","storm.zookeeper.topology.auth.scheme":"digest","topology.workers":2,"storm.thrift.transport":"org.apache.storm.security.auth.kerberos.KerberosSaslTransportPlugin","topology.debug":true,"storm.zookeeper.topology.auth.payload":"-7659255060620243743:-5999822419551893831","topology.eventlogger.executors":1} (StormSubmitter:320) > 2018-04-13 07:34:07,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION new 1.2.1.3.0.0.0-1189 old 1.2.1.3.0.0.0-1189 (Utils:2286) > 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Finished submitting topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE (StormSubmitter:328) > 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] (StormSubmitter:352) > 2018-04-13 07:34:13,279 INFO - [TestNGInvoker-testRetry():[]] ~ successfully logged in. (Login:300) > 2018-04-13 07:34:13,289 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627 (NimbusClient:96) > 2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Invoking the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook] (StormSubmitter:360) > 2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Collecting metadata for a new storm topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE (StormAtlasHook:88) > 2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook] (StormSubmitter:364) > java.lang.RuntimeException: Atlas hook is unable to process the topology. > at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361) [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189] > at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275) [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189] > at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387) [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189] > at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423) [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189] > at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404) [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189] > at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62) [test-classes/:?] > at com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112) [test-classes/:?] > at com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75) [test-classes/:?] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_161] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_161] > at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161] > at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84) [testng-6.8.5.jar:?] > at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46) [testng-6.8.5.jar:?] > at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37) [testng-6.8.5.jar:?] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_161] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_161] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_161] > at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161] > Caused by: java.lang.NullPointerException > at org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95) ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189] > ... 21 more > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)