hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-18808) Make compaction more robust when stats update fails
Date Mon, 26 Feb 2018 22:52:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eugene Koifman updated HIVE-18808:
----------------------------------
    Attachment: HIVE-18808.01.patch

> Make compaction more robust when stats update fails
> ---------------------------------------------------
>
>                 Key: HIVE-18808
>                 URL: https://issues.apache.org/jira/browse/HIVE-18808
>             Project: Hive
>          Issue Type: Improvement
>          Components: Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Major
>         Attachments: HIVE-18808.01.patch
>
>
>  
> Worker.gatherStats() runs a "analyze table..." command to update stats which requires
SessionState.  SessionState objects are cached in ThreadLocal.  If for some reason Session
init fails, it may still get attached to the thread which then causes a subsequent request
that uses the same tread to gather stats fail because it has a bad session object.  HIVE-15658
describes the same issue in a different context.  
> There is currently no way to recycle a session from outside HMS.
> Failure to gather stats should not kill a compaction job which then prevents Cleaner
from running.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message