hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-18383) Qtests: running all cases from TestNegativeCliDriver results in OOMs
Date Wed, 24 Jan 2018 11:12:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-18383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zoltan Haindrich updated HIVE-18383:
------------------------------------
    Attachment:     (was: HIVE-18383.02.patch)

> Qtests: running all cases from TestNegativeCliDriver results in OOMs
> --------------------------------------------------------------------
>
>                 Key: HIVE-18383
>                 URL: https://issues.apache.org/jira/browse/HIVE-18383
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore, Tests
>            Reporter: Zoltan Haindrich
>            Assignee: Zoltan Haindrich
>            Priority: Major
>         Attachments: HIVE-18383.01.patch
>
>
> I think that it is caused by unclosed SessionState objects which are piling up and cause
OOM..
> There is special have been made to start a new sessionstate for every qtest; but the
old one is not closed up to this [point|https://github.com/apache/hive/blob/20c9a3905f4b1b627c935ad54a53a7a59015587c/itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java#L1202]
> this prevents running all {{TestNegativeCliDriver}} tests in one maven call....I keep
getting OOMs
> This issues sometimes appears on the ptest executor as well and its reported as a failed
batch.
> I've gone back in time a bit....seems like at c925cf8d2bdf646f5c3c57ed7252c01b2ab33eec
it was ok to execute the whole batch; but at 1b4baf474c15377cc9f0bacdda317feabeefacaf and
probably also at a42314deb07a1c8d9d4daeaa799ad1c1ebb0c6c9 its not possible anymore. I suspect
that there is possibly another issue....or these are just the consequences that the sessionstate
got heavier by a few hundred bytes; and made it easier to fill up the heap....



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message