Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 85213 invoked from network); 25 Aug 2009 16:27:58 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 25 Aug 2009 16:27:58 -0000 Received: (qmail 88537 invoked by uid 500); 25 Aug 2009 16:28:23 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 88510 invoked by uid 500); 25 Aug 2009 16:28:23 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 88500 invoked by uid 99); 25 Aug 2009 16:28:23 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Aug 2009 16:28:23 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 25 Aug 2009 16:28:20 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 403E6234C04C for ; Tue, 25 Aug 2009 09:27:59 -0700 (PDT) Message-ID: <1480575397.1251217679248.JavaMail.jira@brutus> Date: Tue, 25 Aug 2009 09:27:59 -0700 (PDT) From: "Bradford Stephens (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Created: (HBASE-1791) Timeout in IndexRecordWriter MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Timeout in IndexRecordWriter ---------------------------- Key: HBASE-1791 URL: https://issues.apache.org/jira/browse/HBASE-1791 Project: Hadoop HBase Issue Type: Bug Affects Versions: 0.20.0, 0.20.1, 0.21.0 Environment: 19 HBase nodes, 8 cores, 8 GB RAM, CentOS Reporter: Bradford Stephens Priority: Minor A MapReduce job to generate Lucene Indexes from HBase will fail on sufficiently large tables. After the indexing finished, the close() method of IndexRecordWriter is called. The writer.optimize() call in this method can take many minutes, forcing most MapReduce tasks to timeout. There is a HeartBeatsThread, but it does not seem to send progress updates. A suggested fix may be to add context.progress(); in the HeardbeatsThread run() method, after the context.setStatus call. Not sure why context.setStatus is not "good enough". -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.