Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8C6B9E895 for ; Thu, 24 Jan 2013 04:16:07 +0000 (UTC) Received: (qmail 89035 invoked by uid 500); 24 Jan 2013 04:16:02 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 88923 invoked by uid 500); 24 Jan 2013 04:16:02 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 88896 invoked by uid 99); 24 Jan 2013 04:16:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jan 2013 04:16:01 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.223.181 as permitted sender) Received: from [209.85.223.181] (HELO mail-ie0-f181.google.com) (209.85.223.181) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 24 Jan 2013 04:15:56 +0000 Received: by mail-ie0-f181.google.com with SMTP id 16so14990039iea.12 for ; Wed, 23 Jan 2013 20:15:36 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=3q28TPtnNPiyLsQQDZ6iAzAhrAbYTPWOP3YWlxbC8fY=; b=JetBJABWszj7ueaTSszbGlgu2ZHj6lJ30eIMtRVNZqtC/dlEmRBckdwo7GUPEHfmRL jJjZcqyquY+gxdZlOA/ERxP6bRS1cD/AptFu0afW4pXAVCbRT22pDs/kUz6h5+Kb/Z2A NN8CkGqodyvyp7/qdaHX8aujtnjhgrO/r5h/yt52fgVl9fnTSvZXoTRDGtthu5E45ixo hVHVg3G6Tvl/2zfuVjtMw5RhIMKnppm5He89pH4ucYkwox2s8JUgLJNgbF+6PA1OHzId 7g7h6iGtvEKwhqir7EkSTlqjMKlTN/Yv78/O4Q+jo/pPKRk2KFHbStiB04+xPaC+mbN3 Yq3g== X-Received: by 10.42.54.5 with SMTP id p5mr296856icg.49.1359000936272; Wed, 23 Jan 2013 20:15:36 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.40.108 with HTTP; Wed, 23 Jan 2013 20:15:16 -0800 (PST) In-Reply-To: References: From: Harsh J Date: Thu, 24 Jan 2013 09:45:16 +0530 Message-ID: Subject: Re: Error after upgrading from CDH3 to CDH4 To: "cdh-user@cloudera.org" , Rashmi.Nataraj@acxiom.com Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQklIhzR5Z3Mip6g1En0Cj9Jnr/2RZrOTunw5/h336FlNj585BXFu0VCZuVkEZO0uunKl9Pi X-Virus-Checked: Checked by ClamAV on apache.org Hi Rashmi, Moving the post to cdh-user@cloudera.org (https://groups.google.com/a/cloudera.org/forum/?fromgroups=#!forum/cdh-user) as it is CDH4 you specifically are asking about. BCC'd user@hadoop lists, lets carry forward the discussion on the CDH lists. My response below. With CDH4 (basically with 2.x+), the project now supplies 3 sets of packages each for common libs, hdfs libs and yarn (and also mr) libs. Your error would appear when you run the program without the HDFS libs, since the HDFS implementation classes are now discovered automatically from the available classpath at runtime. If you can tell us what dependencies your project uses, I can help you fix this further. But essentially you need to try to place HDFS libs onto the application's runtime classpath. General note: Your application should be using hadoop-client dependencies as pointed out by https://ccp.cloudera.com/display/CDH4DOC/Managing+Hadoop+API+Dependencies+in+CDH4 and https://ccp.cloudera.com/display/DOC/Hadoop+Tutorial, not the single hadoop-core jar as was in CDH3. On Thu, Jan 24, 2013 at 3:52 AM, Nataraj Rashmi - rnatar wrote: > Hi, > > > > I am getting this error when I run the java application that uses HDFS API > to transfer files to HDFS remotely. This used to work fine with CDH3 and > now we are using CDH4. > > > > Exception in thread "main" java.io.IOException: No FileSystem for scheme: > hdfs > > at > org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2206) > > at > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2213) > > > > I have this in my client config cml. Please help. > > > > > > > > fs.default.name > > hdfs://servername:8020 > > > > > > > > > > Thanks. > > *************************************************************************** > The information contained in this communication is confidential, is > intended only for the use of the recipient named above, and may be legally > privileged. > > If the reader of this message is not the intended recipient, you are > hereby notified that any dissemination, distribution or copying of this > communication is strictly prohibited. > > If you have received this communication in error, please resend this > communication to the sender and delete the original message or any copy > of it from your computer system. > > Thank You. > **************************************************************************** -- Harsh J