Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 03D5FD801 for ; Wed, 22 Aug 2012 16:10:00 +0000 (UTC) Received: (qmail 56580 invoked by uid 500); 22 Aug 2012 16:09:55 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 56473 invoked by uid 500); 22 Aug 2012 16:09:55 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 56466 invoked by uid 99); 22 Aug 2012 16:09:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Aug 2012 16:09:55 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of matthias.zengler@gmail.com designates 209.85.220.176 as permitted sender) Received: from [209.85.220.176] (HELO mail-vc0-f176.google.com) (209.85.220.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Aug 2012 16:09:47 +0000 Received: by vcbfl11 with SMTP id fl11so1499878vcb.35 for ; Wed, 22 Aug 2012 09:09:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:x-google-sender-auth:message-id:subject :from:to:content-type; bh=hFng8Rc0yzOIciiqR979i/33BRRDc528KvB7fTE1vgI=; b=bdHaWpiWy3ilf8pE1wmvVsLtNsHp5sU4B6j4aw5SlEfrH+4HgaB5I/ErWR8kBvE1kA XXItV/v17ZJJOdrrXc+H2O9G4HXSa8sKVsL5UlD9TfBsRROQf1SfHxaZWD/jwv9hdnid 2QKvuBzIrfunQxEIVZEsPb4M97LRHr9NGvLZX9enuaWaIhK2yiOVLo6LboUV1KQl1wWI q1Lx9Ht+4KQNNWkNiab6pNOPnwJL6HNEUU8uFIKA2yOH5upMpalKPrtEoD86V8Dvh4Qu u+2LjMNU4joAt875wTMgGl6dRPAie4r2ZA+IbrqdX1loW4b/rBYwjxz6yJnGh0ZfZ7nJ lQGQ== MIME-Version: 1.0 Received: by 10.58.151.197 with SMTP id us5mr18726599veb.14.1345651766279; Wed, 22 Aug 2012 09:09:26 -0700 (PDT) Sender: matthias.zengler@gmail.com Received: by 10.58.179.112 with HTTP; Wed, 22 Aug 2012 09:09:26 -0700 (PDT) Date: Wed, 22 Aug 2012 18:09:26 +0200 X-Google-Sender-Auth: JA9JodXLtZaG1FqaNoziedLffyc Message-ID: Subject: set replication of output to 1 in CDH3 From: Matthias Kricke To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b6d8354853c7e04c7dcf786 --047d7b6d8354853c7e04c7dcf786 Content-Type: text/plain; charset=ISO-8859-1 Dear mailing list, I want to set the replication of my output file to 1 for clouderas hadoop 3. Some web research told me to do the following: hadoop jar fu.jar com.bar -D dfs.replication=1 input output I adapted it a bit, because my jar has a specified main class. I do something like that: hadoop jar fu.jar -D dfs.replication=1 input output When I now execute this, I get the following error: 12/08/22 18:04:42 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 12/08/22 18:04:43 INFO mapred.JobClient: Cleaning up the staging area someServerAndFileAdress Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: someServerAndFileAdress*/-D* at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:231) at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248) at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944) at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:961) at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833) at org.apache.hadoop.mapreduce.Job.submit(Job.java:476) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:506) at com.unister.semweb.preprocessingMapperStyle.core.StartMapper.main(StartMapper.java:43) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:186) I would appreciate your help. Greetings, MK --047d7b6d8354853c7e04c7dcf786 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Dear mailing list,

I want to set the replication of my o= utput file to 1 for clouderas hadoop 3. Some web research told me to do the= following:
hadoop jar fu.jar com.bar -D dfs.replication=3D1 inpu= t output

I adapted it a bit, because my jar has a specified main= class. I do something like that:
hadoop jar fu.jar -D dfs.replic= ation=3D1 input output

When I now execute this, I = get the following error:

12/08/22 18:04:42 WARN mapred.JobClient: Use Gener= icOptionsParser for parsing the arguments. Applications should implement To= ol for the same.
12/08/22 18:04:43 INFO mapred.JobClient: Cleanin= g up the staging area someServerAndFileAdress
Exception in thread "main" org.apache.hadoop.mapreduce.lib.i= nput.InvalidInputException: Input path does not exist:=A0someServerAndFileA= dress/-D
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.li= stStatus(FileInputFormat.java:231)
at or= g.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputForm= at.java:248)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient= .java:944)
at or= g.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:961)
= at org.apa= che.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at or= g.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
at org.apache.ha= doop.mapred.JobClient$2.run(JobClient.java:833)
at ja= va.security.AccessController.doPrivileged(Native Method)
at javax.security.= auth.Subject.doAs(Subject.java:396)
at or= g.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.jav= a:1127)
= at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.j= ava:833)
at or= g.apache.hadoop.mapreduce.Job.submit(Job.java:476)
at org.apache.hadoop.map= reduce.Job.waitForCompletion(Job.java:506)
at co= m.unister.semweb.preprocessingMapperStyle.core.StartMapper.main(StartMapper= .java:43)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at su= n.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)=
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso= rImpl.java:25)
at ja= va.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.Ru= nJar.main(RunJar.java:186)

I would appreciate your help.

Greetings,
MK

--047d7b6d8354853c7e04c7dcf786--