hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13249) Hard upper bound on number of open transactions
Date Wed, 18 May 2016 18:19:12 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wei Zheng updated HIVE-13249:
-----------------------------
    Attachment: HIVE-13249.11.patch

Patch 11 moved two tests TestCompactionTxnHandler.java and TestTxnHandler.java from metastore/src/test/org/apache/hadoop/hive/metastore/txn/
 to ql/src/test/org/apache/hadoop/hive/metastore/txn/

The reason is due to the change in TxnHandler.openTxns, the class "org.apache.hadoop.hive.ql.txn.AcidOpenTxnsCounterService"
in ql package needs to be loaded from metastore package. This is OK during runtime, when we
have hive-exec.jar that's needed for this. But for unit test things are different. We don't
have the jar from which to load the class. So the solution is to move the affected unit test
classes from metastore directory to ql directory, while they still belong to metastore package.

> Hard upper bound on number of open transactions
> -----------------------------------------------
>
>                 Key: HIVE-13249
>                 URL: https://issues.apache.org/jira/browse/HIVE-13249
>             Project: Hive
>          Issue Type: Improvement
>          Components: Transactions
>    Affects Versions: 2.0.0
>            Reporter: Wei Zheng
>            Assignee: Wei Zheng
>         Attachments: HIVE-13249.1.patch, HIVE-13249.10.patch, HIVE-13249.11.patch, HIVE-13249.2.patch,
HIVE-13249.3.patch, HIVE-13249.4.patch, HIVE-13249.5.patch, HIVE-13249.6.patch, HIVE-13249.7.patch,
HIVE-13249.8.patch, HIVE-13249.9.patch
>
>
> We need to have a safeguard by adding an upper bound for open transactions to avoid huge
number of open-transaction requests, usually due to improper configuration of clients such
as Storm.
> Once that limit is reached, clients will start failing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message