hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10595) Dropping a table can cause NPEs in the compactor
Date Tue, 05 May 2015 17:40:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14528863#comment-14528863
] 

Alan Gates commented on HIVE-10595:
-----------------------------------

More details:
# Dropping a table did not impact the initiator thread, as it could already handle not finding
a table.  However, it was assuming that all such cases were temp tables.
# Dropping a table before the worker thread or cleaner thread got to it caused bogus error
messages.  In the case of the worker it also prevented forward progress on compacting any
other requests, as the dropped table stayed at the head of the queue.
# Dropping a partition before any of the threads got to it caused the compaction do to be
done against the table rather than the partition, which would result in an error once the
compaction work started.

> Dropping a table can cause NPEs in the compactor
> ------------------------------------------------
>
>                 Key: HIVE-10595
>                 URL: https://issues.apache.org/jira/browse/HIVE-10595
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 0.14.0, 1.0.0, 1.1.0
>            Reporter: Alan Gates
>            Assignee: Alan Gates
>
> Reproduction:
> # start metastore with compactor off
> # insert enough entries in a table to trigger a compaction
> # drop the table
> # stop metastore
> # restart metastore with compactor on
> Result:  NPE in the compactor threads.  I suspect this would also happen if the inserts
and drops were done in between a run of the compactor, but I haven't proven it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message