atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Qiang Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-1045) HiveHook fails to post metadata for "Create view" with "Relative path in absolute URI: NULL::character%20varying" exception
Date Mon, 24 Oct 2016 06:18:58 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601086#comment-15601086
] 

Qiang Zhang commented on ATLAS-1045:
------------------------------------

Hi  Ayub Khan,
as you error  describe :Unable to fetch table sample_view_1
 i have test it in lastest code in  https://github.com/apache/incubator-atlas  and  find it
test well 
or can you tell me more about you test enviorment 
 such as have you install Solr or Elasticsearch  correctly , what you hive table stoted file
directory
and besure you have install Hive metastore and thrift have configure well.  

> HiveHook fails to post metadata for "Create view" with "Relative path in absolute URI:
NULL::character%20varying" exception
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: ATLAS-1045
>                 URL: https://issues.apache.org/jira/browse/ATLAS-1045
>             Project: Atlas
>          Issue Type: Bug
>    Affects Versions: trunk, 0.7-incubating
>            Reporter: Ayub Khan
>            Assignee: Qiang Zhang
>            Priority: Critical
>
> *Impact: No metadata for "create view" on atlas.*
> Steps to repro:
> {noformat}
> * create table sample (abc String);
> * create view sample_view_1 (url COMMENT 'URL of Referring page') AS  SELECT * from sample;
> {noformat}
> Hiveserver2.log snapshot
> {noformat}
> 2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: hooks.ATSHook
(ATSHook.java:<init>(90)) - Created ATS Hook
> 2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook
from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,371 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook
start=1469294904371 end=1469294904371 duration=0 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook
from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=PostHook.org.apache.atlas.hive.hook.HiveHook
start=1469294904372 end=1469294904372 duration=0 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,372 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (Driver.java:execute(1635))
- Resetting the caller context to HIVE_SSN_ID:8cc6511f-5454-431b-aa2f-d7a1c11159a7
> 2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=Driver.execute start=1469294904326
end=1469294904373 duration=47 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: ql.Driver (SessionState.java:printInfo(939))
- OK
> 2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=releaseLocks start=1469294904373 end=1469294904373
duration=0 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,373 INFO  [HiveServer2-Background-Pool: Thread-9870]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=Driver.run start=1469294904233 end=1469294904373
duration=140 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,373 INFO  [Atlas Logger 1]: hook.HiveHook (HiveHook.java:fireAndForget(202))
- Entered Atlas hook for hook type POST_EXEC_HOOK operation CREATEVIEW
> 2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
> 2016-07-23 17:28:24,374 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
> 2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
> 2016-07-23 17:28:24,380 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
> 2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161))
- Importing objects from databaseName : default
> 2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_table : db=default tbl=sample
> 2016-07-23 17:28:24,385 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_table
: db=default tbl=sample
> 2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,387 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,392 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,396 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:acquireAfterOpLock(332)) - We are setting the hadoop caller context
to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger
(PerfLogger.java:PerfLogBegin(148)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: log.PerfLogger
(PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=releaseLocks start=1469294904416 end=1469294904416
duration=0 from=org.apache.hadoop.hive.ql.Driver>
> 2016-07-23 17:28:24,416 INFO  [HiveServer2-HttpHandler-Pool: Thread-62]: session.HiveSessionImpl
(HiveSessionImpl.java:releaseBeforeOpLock(356)) - We are resetting the hadoop caller context
for thread HiveServer2-HttpHandler-Pool: Thread-62
> 2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateTableInstance(411))
- Importing objects from default.sample
> 2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
> 2016-07-23 17:28:24,424 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
> 2016-07-23 17:28:24,439 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_database: default
> 2016-07-23 17:28:24,440 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_database:
default
> 2016-07-23 17:28:24,445 INFO  [Atlas Logger 1]: bridge.HiveMetaStoreBridge (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161))
- Importing objects from databaseName : default
> 2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(822))
- 6: get_table : db=default tbl=sample_view_1
> 2016-07-23 17:28:24,446 INFO  [Atlas Logger 1]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(391))
- ugi=hive/nat-s11-4-kuls-atlas-1.openstacklocal@HWQE.HORTONWORKS.COM	ip=unknown-ip-addr	cmd=get_table
: db=default tbl=sample_view_1
> 2016-07-23 17:28:24,463 ERROR [Atlas Logger 1]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invokeInternal(195))
- java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute
URI: NULL::character%20varying
> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
> 	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
> 	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
> 	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
> 	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
> 	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
> 	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
> 	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
> 	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
> 	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
> 	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
> 	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
> 	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
> 	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
> 	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
> 	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
> 	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
> 	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
> 	at java.net.URI.checkPath(URI.java:1823)
> 	at java.net.URI.<init>(URI.java:745)
> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
> 	... 35 more
> 2016-07-23 17:28:24,464 ERROR [Atlas Logger 1]: hook.HiveHook (HiveHook.java:run(188))
- Atlas hook failed due to error
> org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table sample_view_1.
java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1165)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
> 	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
> 	at org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
> 	at org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
> 	at org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
> 	at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
> 	at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
> 	at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative
path in absolute URI: NULL::character%20varying
> 	at org.apache.hadoop.fs.Path.initialize(Path.java:205)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:171)
> 	at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
> 	at org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
> 	at org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
> 	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
> 	at org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
> 	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
> 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
> 	at com.sun.proxy.$Proxy13.get_table(Unknown Source)
> 	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
> 	at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
> 	at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
> 	at com.sun.proxy.$Proxy14.getTable(Unknown Source)
> 	at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
> 	... 13 more
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: NULL::character%20varying
> 	at java.net.URI.checkPath(URI.java:1823)
> 	at java.net.URI.<init>(URI.java:745)
> 	at org.apache.hadoop.fs.Path.initialize(Path.java:202)
> 	... 35 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message