atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ayub Khan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ATLAS-1045) HiveHook fails to post metadata for "Create view" with "Relative path in absolute URI: NULL::character%20varying" exception
Date Sat, 23 Jul 2016 17:46:20 GMT
Ayub Khan created ATLAS-1045:
--------------------------------

             Summary: HiveHook fails to post metadata for "Create view" with "Relative path
in absolute URI: NULL::character%20varying" exception
                 Key: ATLAS-1045
                 URL: https://issues.apache.org/jira/browse/ATLAS-1045
             Project: Atlas
          Issue Type: Bug
    Affects Versions: trunk, 0.7-incubating
            Reporter: Ayub Khan
            Priority: Critical


*Impact: No metadata for "create view" on atlas.*

Steps to repro:
{noformat}
* create table sample (abc String);
* create view sample_view_1 (url COMMENT 'URL of Referring page') AS  SELECT * from sample;
{noformat}


Hiveserver2.log snapshot
{noformat}
2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: hooks.ATSHook (ATSHook.java:<init>(90))
- Created ATS Hook
2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148))
- <PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1469294904371
end=1469294904371 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148))
- <PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1469294904372 end=1469294904372
duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (Driver.java:execute(1635))
- Resetting the caller context to HIVE_SSN_ID:8cc6511f-5454-431b-aa2f-d7a1c11159a7
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=Driver.execute start=1469294904326 end=1469294904373 duration=47 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (SessionState.java:printInfo(939))
- OK
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148))
- <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=releaseLocks start=1469294904373 end=1469294904373 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=Driver.run start=1469294904233 end=1469294904373 duration=140 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO  [Atlas Logger 1]: hook.HiveHook (HiveHook.java:fireAndForget(202))
- Entered Atlas hook for hook type POST_EXEC_HOOK operation CREATEVIEW
2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161))
- Importing objects from databaseName : default
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_table : db=default tbl=sample
2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_table
: db=default tbl=sample
2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,396 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger (PerfLogger.java:PerfLogBegin(148))
- <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger (PerfLogger.java:PerfLogEnd(176))
- </PERFLOG method=releaseLocks start=1469294904416 end=1469294904416 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateTableInstance(411))
- Importing objects from default.sample
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
2016-07-23 17:28:24,439 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
2016-07-23 17:28:24,440 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
2016-07-23 17:28:24,445 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161))
- Importing objects from databaseName : default
2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_table : db=default tbl=sample_view_1
2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_table
: db=default tbl=sample_view_1
2016-07-23 17:28:24,463 ERROR [Atlas Logger 1]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invokeInternal(195))
- java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute
URI: NULL::character%20varying
	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at java.net.URI.checkPath(URI.java:1823)
	at java.net.URI.<init>(URI.java:745)
	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
	... 35 more

2016-07-23 17:28:24,464 ERROR [Atlas Logger 1]: hook.HiveHook (HiveHook.java:run(188)) - Atlas
hook failed due to error
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table sample_view_1. java.net.URISyntaxException:
Relative path in absolute URI: NULL::character%20varying
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1165)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path
in absolute URI: NULL::character%20varying
	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
	... 13 more
Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
	at java.net.URI.checkPath(URI.java:1823)
	at java.net.URI.<init>(URI.java:745)
	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
	... 35 more
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message