atlas-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ATLAS-464) HiveHook execution threads could crash due to a race condition
Date Tue, 10 May 2016 02:32:12 GMT

    [ https://issues.apache.org/jira/browse/ATLAS-464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277499#comment-15277499
] 

Hemanth Yamijala commented on ATLAS-464:
----------------------------------------

[~ssainath], with changes that came in with ATLAS-512, I think this situation no longer occurs.
Can you please validate this once?

> HiveHook execution threads could crash due to a race condition
> --------------------------------------------------------------
>
>                 Key: ATLAS-464
>                 URL: https://issues.apache.org/jira/browse/ATLAS-464
>             Project: Atlas
>          Issue Type: Bug
>            Reporter: Hemanth Yamijala
>         Attachments: hive-hook-exception.txt
>
>
> Enable Atlas HiveHook in Hive with default config and an empty Atlas DB. Fire queries
fast to create tables - for e.g. by having table definitions in a file and executing with
hive -f <filename>. In the hive logs, we can see exceptions that hive types are being
redefined. The executor threads crash due to this exception. Sample of the exception log (will
attach the full log separately):
> {code}
> 2016-02-02 16:08:15,152 INFO  [Atlas Logger 4]: hook.HiveHook (HiveHook.java:run(190))
- Atlas hook failed
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE failed with
status 400(Bad Request) Response Body ({"error":"Redefinition of type hive_object_type not
supported","stackTrace":"org.apache.atlas.AtlasException: Redefinition of type hive_object_type
not supported\n\tat org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.step1(TypeSystem.java:348)\n\tat
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.defineTypes(TypeSystem.java:566)\n\tat
org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.defineTypes(TypeSystem.java:562)\n\tat
org.apache.atlas.typesystem.types.TypeSystem.defineTypes(TypeSystem.java:255)\n\tat org.apache.atlas.typesystem.types.TypeSystem.defineTypes(TypeSystem.java:247)\n\tat
org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:173)\n\t
> {code}
> Thanks, [~ssainath] for finding this bug.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message