Return-Path: X-Original-To: apmail-accumulo-notifications-archive@minotaur.apache.org Delivered-To: apmail-accumulo-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ABB48D446 for ; Wed, 19 Dec 2012 23:01:26 +0000 (UTC) Received: (qmail 26134 invoked by uid 500); 19 Dec 2012 23:01:26 -0000 Delivered-To: apmail-accumulo-notifications-archive@accumulo.apache.org Received: (qmail 26100 invoked by uid 500); 19 Dec 2012 23:01:26 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 26089 invoked by uid 99); 19 Dec 2012 23:01:26 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 19 Dec 2012 23:01:26 +0000 Date: Wed, 19 Dec 2012 23:01:26 +0000 (UTC) From: "Hudson (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ACCUMULO-408) Large bulk imports timing out MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ACCUMULO-408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536538#comment-13536538 ] Hudson commented on ACCUMULO-408: --------------------------------- Integrated in Accumulo-1.4.x #256 (See [https://builds.apache.org/job/Accumulo-1.4.x/256/]) ACCUMULO-408 merge from trunk (Revision 1424065) ACCUMULO-408 use sync to make sure we do not read old data from zookeeper (Revision 1424053) Result = SUCCESS ecn : Files : * /accumulo/branches/1.4 * /accumulo/branches/1.4/src * /accumulo/branches/1.4/src/core * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/ZooReader.java * /accumulo/branches/1.4/src/server ecn : Files : * /accumulo/branches/1.4 * /accumulo/branches/1.4/src * /accumulo/branches/1.4/src/core * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/client/impl/ServerClient.java * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/conf/Property.java * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/util/ThriftUtil.java * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/IZooReader.java * /accumulo/branches/1.4/src/core/src/main/java/org/apache/accumulo/core/zookeeper/ZooReader.java * /accumulo/branches/1.4/src/server * /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/client/BulkImporter.java * /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/master/tableOps/BulkImport.java * /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/tabletserver/TabletServer.java * /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/zookeeper/TransactionWatcher.java > Large bulk imports timing out > ----------------------------- > > Key: ACCUMULO-408 > URL: https://issues.apache.org/jira/browse/ACCUMULO-408 > Project: Accumulo > Issue Type: Bug > Components: master, tserver > Affects Versions: 1.4.0 > Reporter: Keith Turner > Assignee: Eric Newton > Priority: Critical > Fix For: 1.5.0 > > > Large bulk imports that take more than 2 minutes to process are failing. The master ask a tablet sever to bulk import the files and times out after 2 minutes. It retries, but the retry will take over 2 minutes. Eventually it gives up and starts copying all of the data to the fail dir which takes forever. This copy is all through the master and for large data basically never completes. The bulk import threads on the tablet server probably complete eventually, so the data is still there. > The master should not time these request out. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira