Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 935ED7F16 for ; Wed, 21 Dec 2011 22:58:04 +0000 (UTC) Received: (qmail 11627 invoked by uid 500); 21 Dec 2011 22:58:03 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 11596 invoked by uid 500); 21 Dec 2011 22:58:03 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 11588 invoked by uid 99); 21 Dec 2011 22:58:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Dec 2011 22:58:03 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of aleksandr@fb.com designates 67.231.153.30 as permitted sender) Received: from [67.231.153.30] (HELO mx0a-00082601.pphosted.com) (67.231.153.30) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Dec 2011 22:57:55 +0000 Received: from pps.filterd (m0004077 [127.0.0.1]) by mx0b-00082601.pphosted.com (8.14.4/8.14.4) with SMTP id pBLMrkFO007224 for ; Wed, 21 Dec 2011 14:57:34 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fb.com; h=message-id : date : from : mime-version : to : subject : references : in-reply-to : content-type : content-transfer-encoding; s=facebook; bh=deFL4WSi1fQyP4WqV+E5ul+swd+VuNmLXmMGkZgeUyU=; b=CvK41fOOWIWR+AUPhTJnicD6J1umjUnnehJ7qHozxeoVez3nQPzJaEOT2luf5CSHmh9t ze9yjU8RX7h35Ob0daf6n0f65qdK2k9J/cxNpiLw/hTMpMg3NCTq3JOMcVFSIw7S7zmq 3i2senEhTcw2y/ztF7C2E7Kp+wEwLX036to= Received: from mail.thefacebook.com (corpout1.snc1.tfbnw.net [66.220.144.38]) by mx0b-00082601.pphosted.com with ESMTP id 11urkn8077-1 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT) for ; Wed, 21 Dec 2011 14:57:34 -0800 Received: from [172.16.217.160] (192.168.18.252) by mail.TheFacebook.com (192.168.18.198) with Microsoft SMTP Server (TLS) id 14.1.355.2; Wed, 21 Dec 2011 14:57:30 -0800 Message-ID: <4EF2645A.4050705@fb.com> Date: Wed, 21 Dec 2011 14:57:30 -0800 From: Aleksandr Levchuk User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:8.0) Gecko/20111124 Thunderbird/8.0 MIME-Version: 1.0 To: Subject: Re: What version of HDFS is compatible with HBase? References: <20111221141826.7098ff60d8000ac98b0356cd27c73871.3c0b159597.wbe@email04.secureserver.net> <4EF25AF4.4040906@fb.com> In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [192.168.18.252] X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.5.7110,1.0.211,0.0.0000 definitions=2011-12-21_08:2011-12-21,2011-12-21,1970-01-01 signatures=0 X-Proofpoint-Spam-Reason: safe X-Virus-Checked: Checked by ClamAV on apache.org As you suggested, I replaced hadoop-core-0.20-append-r1056497.jar with hadoop-core-0.20.205.0.jar (in hbase's lib) on the machines of the cluster, but now when start-hbase.sh on the master gives: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem. ... at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395) at org.apache.hadoop.fs.FileSystem$Cache$Key.(FileSystem.java:1436) Alex On 12/21/2011 02:21 PM, Jean-Daniel Cryans wrote: >> I added dfs.support.append=true configuration everywhere but I get the same >> "got version 3 expected version 4" problem. > > Setting this won't solve your version problem. > >> How do I update the jars in the hbase lib directory? > > Remove the hadoop jar that's in there, replace it with the 0.20.205 one. > >>> This makes it look like hadoop-0.20.205.0 and hbase-0.90.4 are >>> incompatible. > > This error really means that you didn't replace the jars correctly, > the version is contained in the Hadoop jar and HBase isn't involved at > all. From http://hbase.apache.org/book/hadoop.html > > "Because HBase depends on Hadoop, it bundles an instance of the Hadoop > jar under its lib directory. The bundled jar is ONLY for use in > standalone mode. In distributed mode, it is critical that the version > of Hadoop that is out on your cluster match what is under HBase. > Replace the hadoop jar found in the HBase lib directory with the > hadoop jar you are running on your cluster to avoid version mismatch > issues. Make sure you replace the jar in HBase everywhere on your > cluster. Hadoop version mismatch issues have various manifestations > but often all looks like its hung up." > > J-D