hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sankar Hariappan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-17195) Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.
Date Fri, 28 Jul 2017 11:06:04 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sankar Hariappan updated HIVE-17195:
------------------------------------
    Attachment: HIVE-17195.01.patch

Added 01.patch with changes to replace recursive calls with while loops when traverse the
DAGs.
Request [~daijy]/[~anishek]/[~thejas] to please review it!

> Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.
> --------------------------------------------------------------------------
>
>                 Key: HIVE-17195
>                 URL: https://issues.apache.org/jira/browse/HIVE-17195
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, repl
>    Affects Versions: 2.1.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>             Fix For: 3.0.0
>
>         Attachments: HIVE-17195.01.patch
>
>
> Currently, long chain REPL LOAD tasks lead to huge recursive calls when try to traverse
the DAG.
> For example, getMRTasks, getTezTasks, getSparkTasks and iterateTasks methods run recursively
to traverse the DAG.
> Need to modify this traversal logic to reduce stack usage.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message