hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-14129) Execute move tasks in parallel
Date Thu, 04 Aug 2016 17:22:20 GMT

    [ https://issues.apache.org/jira/browse/HIVE-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408166#comment-15408166
] 

Thejas M Nair commented on HIVE-14129:
--------------------------------------

[~ashutoshc] It doesn't look like the 2nd issue is fixed. ie -
bq. 2. SessionState is examined by acid code in MoveTask, if it is in a different thread that
thread will not have the SessionState object available.

TaskRunner would need an additional method - setSessionState, similar to setOperationLog,
that sets the thread local sessionstate.
Also, we should check if the methods being used in MoveTask on SessionState for acid purposes
are thread safe. Looking at the method names, I would expect it to be threadsafe. cc [~ekoifman]

Without that we might have issues with ACID and execparallel=true.


> Execute move tasks in parallel
> ------------------------------
>
>                 Key: HIVE-14129
>                 URL: https://issues.apache.org/jira/browse/HIVE-14129
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-14129.2.patch, HIVE-14129.patch, HIVE-14129.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message