From hdfs-dev-return-1208-apmail-hadoop-hdfs-dev-archive=hadoop.apache.org@hadoop.apache.org Fri Jun 11 19:03:06 2010 Return-Path: Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: (qmail 64718 invoked from network); 11 Jun 2010 19:03:06 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 11 Jun 2010 19:03:06 -0000 Received: (qmail 31795 invoked by uid 500); 11 Jun 2010 19:03:06 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 31719 invoked by uid 500); 11 Jun 2010 19:03:05 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 31711 invoked by uid 99); 11 Jun 2010 19:03:05 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jun 2010 19:03:05 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of awittenauer@linkedin.com designates 69.28.149.24 as permitted sender) Received: from [69.28.149.24] (HELO esv4-mav02.corp.linkedin.com) (69.28.149.24) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Jun 2010 19:02:59 +0000 DomainKey-Signature: s=prod; d=linkedin.com; c=nofws; q=dns; h=X-IronPort-AV:Received:Received:Received:From:To:Subject: Thread-Topic:Thread-Index:Date:Message-ID:References: In-Reply-To:Accept-Language:Content-Language: X-MS-Has-Attach:X-MS-TNEF-Correlator:Content-Type: Content-ID:Content-Transfer-Encoding:MIME-Version: Return-Path:X-OriginalArrivalTime; b=OqoqCOv/svssn2j++Lrq5aGTIxmwGAiE84q7XpswYpsI9ExhnNu++vE4 auvVXPq6iS7hU/RoMvEg8U4lMlz4j+fiIvh3iBDi/TxmRDF+JmhXsx2tj Tb0e/EwnECrz+9D; DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=linkedin.com; i=awittenauer@linkedin.com; q=dns/txt; s=proddkim; t=1276282979; x=1307818979; h=from:sender:reply-to:subject:date:message-id:to:cc: mime-version:content-transfer-encoding:content-id: content-description:resent-date:resent-from:resent-sender: resent-to:resent-cc:resent-message-id:in-reply-to: references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:list-owner:list-archive; z=From:=20Allen=20Wittenauer=20 |Subject:=20Re:=20Integrating=20Lustre=20and=20HDFS|Date: =20Fri,=2011=20Jun=202010=2019:02:37=20+0000|Message-ID: =20 |To:=20""=20|MIME-Version:=201.0 |Content-Transfer-Encoding:=20quoted-printable |Content-ID:=20 |In-Reply-To:=20|References:=20=0D=0A=20<7C47C8 A4-5219-4333-ABCA-7FF326E022AF@linkedin.com>=0D=0A=20=0D=0A=20; bh=/w+sQr0p8nBygqVBPuIatx/bkH7bm1dtOg6fVHGIRW0=; b=I0upRb3sd80ufNOVyGfuDN2Ei529FSOqjo4aFgSxxMHVKiejdVEpILM3 FRMQvajHbm4BYGcSqwfUJGjxnaPtsPd7EOOTsiFilWRgyJQxM++ecVB3o YPUDGDU2prhUaC8; X-IronPort-AV: E=Sophos;i="4.53,404,1272870000"; d="scan'208";a="13398920" Received: from esv4-exctest.linkedin.biz ([172.18.46.60]) by CORP-MAIL.linkedin.biz with Microsoft SMTPSVC(6.0.3790.3959); Fri, 11 Jun 2010 12:02:38 -0700 Received: from ESV4-CAS02.linkedin.biz (172.18.46.142) by esv4-exctest.linkedin.biz (172.18.46.60) with Microsoft SMTP Server (TLS) id 14.0.682.1; Fri, 11 Jun 2010 12:02:37 -0700 Received: from ESV4-EXC03.linkedin.biz ([fe80::985a:a6b4:f1e1:23b0]) by esv4-cas02.linkedin.biz ([172.18.46.142]) with mapi; Fri, 11 Jun 2010 12:02:37 -0700 From: Allen Wittenauer To: "" Subject: Re: Integrating Lustre and HDFS Thread-Topic: Integrating Lustre and HDFS Thread-Index: AQHLCICi0a7Q1I5gr02k6tEKCqY/dJJ7rhSAgAALooCAANa/AIABBTKA Date: Fri, 11 Jun 2010 19:02:37 +0000 Message-ID: References: <7C47C8A4-5219-4333-ABCA-7FF326E022AF@linkedin.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginalArrivalTime: 11 Jun 2010 19:02:38.0736 (UTC) FILETIME=[A920A900:01CB0998] X-Virus-Checked: Checked by ClamAV on apache.org On Jun 10, 2010, at 8:27 PM, Vikas Ashok Patil wrote: > Thanks for the replies. >=20 > If I have fs.default.name =3D file://my_lustre_mount_point , then only th= e > lustre filesystem will be used. I would like to have something like >=20 > fs.default.name=3Dfile://my_lustre_mount_point , hdfs://localhost:9123 >=20 > so that both local filesystem and lustre are in use. >=20 > Kindly correct me if I am missing something here. I guess we're all confused as to your use case. Why do you want to run two= distributed file systems on the same nodes? Why can't you use Lustre for = all your needs? As to fs.default.name, you can only have one. [That's why it is a default.= *smile*] If you want to access more than one file system from within MapR= educe, you'll need to specify it explicitly.=