hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sahil Takiar (JIRA)" <>
Subject [jira] [Created] (HIVE-18869) Improve SparkTask OOM Error Parsing Logic
Date Tue, 06 Mar 2018 04:51:00 GMT
Sahil Takiar created HIVE-18869:

             Summary: Improve SparkTask OOM Error Parsing Logic
                 Key: HIVE-18869
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Sahil Takiar

The method {{SparkTask#isOOMError}} parses a stack-trace to check if it is due to an OOM error.
A few improvements could be made:

* Differentiate between driver OOM and task OOM
* The string {{Container killed by YARN for exceeding memory limits}} is printed if a container
exceeds its memory limits, but Spark tasks can OOM for other reasons, such as {{GC overhead
limit exceeded}}

This message was sent by Atlassian JIRA

View raw message