impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henry Robinson (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (IMPALA-5106) KRPC DCHECK hit when closing DataStreamRecvr
Date Fri, 24 Mar 2017 22:00:43 GMT

     [ https://issues.apache.org/jira/browse/IMPALA-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Henry Robinson resolved IMPALA-5106.
------------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.9.0

Fixed by my patch for IMPALA-4856. (It's a little tricky tracking bugs on a branch where we
can go back in time and rewrite the offending commit).

> KRPC DCHECK hit when closing DataStreamRecvr
> --------------------------------------------
>
>                 Key: IMPALA-5106
>                 URL: https://issues.apache.org/jira/browse/IMPALA-5106
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Distributed Exec
>    Affects Versions: Impala 2.9.0
>            Reporter: Henry Robinson
>            Assignee: Henry Robinson
>            Priority: Blocker
>             Fix For: Impala 2.9.0
>
>
> Looks like a {{RowBatch}} wasn't destroyed before the {{DataStreamRecvr}} was closed.
> {{Close()}} can arrive while a {{TransmitData()}} RPC is in flight, because of the asynchronous
nature of the new RPC flow. And recent changes have made the locking in {{AddBatch()}} quite
fine-grained. So the {{mem_tracker}} might be destroyed during {{AddBatch()}}, before the
{{RowBatch}} is finished with. Looking at the code, it could also be torn down before the
{{RowBatch}} is created, which would lead to an exception as well. 
> {code}
> F0320 18:11:23.188339  4263 mem-tracker.cc:194] Check failed: consumption_->current_value()
== 0 (24544 vs. 0) DataStreamRecvr
>     @          0x1755bab  impala::MemTracker::~MemTracker()
>     @          0x1740cbc  boost::checked_delete<>()
>     @          0x173ef55  boost::scoped_ptr<>::~scoped_ptr()
>     @          0x173f43f  boost::scoped_ptr<>::reset()
>     @          0x17aed5f  impala::DataStreamRecvr::Close()
>     @          0x1ab0969  impala::ExchangeNode::Close()
>     @          0x1e95d65  impala::PlanFragmentExecutor::Close()
>     @          0x1e8dc83  impala::FragmentInstanceState::Exec()
>     @          0x1e98e65  impala::QueryExecMgr::ExecFInstance()
>     @          0x1e9bca2  boost::_mfi::mf1<>::operator()()
>     @          0x1e9bb2b  boost::_bi::list2<>::operator()<>()
>     @          0x1e9b65f  boost::_bi::bind_t<>::operator()()
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message