Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 37859 invoked from network); 18 Dec 2009 00:16:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 18 Dec 2009 00:16:46 -0000 Received: (qmail 94022 invoked by uid 500); 18 Dec 2009 00:16:45 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 93962 invoked by uid 500); 18 Dec 2009 00:16:45 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 93952 invoked by uid 99); 18 Dec 2009 00:16:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Dec 2009 00:16:45 +0000 X-ASF-Spam-Status: No, hits=-10.5 required=5.0 tests=AWL,BAYES_00,RCVD_IN_DNSWL_HI X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Dec 2009 00:16:38 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 350D0234C498 for ; Thu, 17 Dec 2009 16:16:18 -0800 (PST) Message-ID: <1397732732.1261095378202.JavaMail.jira@brutus> Date: Fri, 18 Dec 2009 00:16:18 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Updated: (HBASE-1960) Master should wait for DFS to come up when creating hbase.version In-Reply-To: <654831042.1257612932456.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell updated HBASE-1960: ---------------------------------- Attachment: HBASE-1960.patch {noformat} [...] 09/12/17 16:10:17 INFO util.FSUtils: Waiting for dfs to come up... 09/12/17 16:10:27 INFO util.FSUtils: Waiting for dfs to come up... 09/12/17 16:10:37 INFO util.FSUtils: Waiting for dfs to come up... 09/12/17 16:10:47 INFO util.FSUtils: Waiting for dfs to come up... 09/12/17 16:10:58 INFO master.HMaster: BOOTSTRAP: creating ROOT and first META regions [...] {noformat} > Master should wait for DFS to come up when creating hbase.version > ----------------------------------------------------------------- > > Key: HBASE-1960 > URL: https://issues.apache.org/jira/browse/HBASE-1960 > Project: Hadoop HBase > Issue Type: Bug > Reporter: Andrew Purtell > Priority: Minor > Fix For: 0.20.3, 0.21.0 > > Attachments: HBASE-1960.patch > > > The master does not wait for DFS to come up in the circumstance where the DFS master is started for the first time after format and no datanodes have been started yet. > {noformat} > 2009-11-07 11:47:28,115 INFO org.apache.hadoop.hbase.master.HMaster: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Sun Microsystems Inc., vmVersion=14.2-b01 > 2009-11-07 11:47:28,116 INFO org.apache.hadoop.hbase.master.HMaster: vmInputArguments=[-Xmx1000m, -XX:+HeapDumpOnOutOfMemoryError, -XX:+UseConcMarkSweepGC, -XX:+CMSIncrementalMode, -Dhbase.log.dir=/mnt/hbase/logs, -Dhbase.log.file=hbase-root-master-ip-10-242-15-159.log, -Dhbase.home.dir=/usr/local/hbase-0.20.1/bin/.., -Dhbase.id.str=root, -Dhbase.root.logger=INFO,DRFA, -Djava.library.path=/usr/local/hbase-0.20.1/bin/../lib/native/Linux-amd64-64] > 2009-11-07 11:47:28,247 INFO org.apache.hadoop.hbase.master.HMaster: My address is ip-10-242-15-159.ec2.internal:60000 > 2009-11-07 11:47:28,728 WARN org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /hbase/hbase.version could only be replicated to 0 nodes, instead of 1 > at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1267) > at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:422) > [...] > 2009-11-07 11:47:28,728 WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for block null bad datanode[0] nodes == null > 2009-11-07 11:47:28,728 WARN org.apache.hadoop.hdfs.DFSClient: Could not get block locations. Source file "/hbase/hbase.version" - Aborting... > 2009-11-07 11:47:28,729 FATAL org.apache.hadoop.hbase.master.HMaster: Not starting HMaster because: > org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /hbase/hbase.version could only be replicated to 0 nodes, instead of 1 > at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1267) > at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:422) > {noformat} > Should probably sleep and retry the write a few times. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.