hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Argumments to Hadoop Command
Date Mon, 26 Nov 2012 14:32:54 GMT
Hi,

Please check http://pastebin.com/phFZgkrQ for a proper version. When
using Tool/Configured, reuse the already prepared configuration (i.e.
getConf()) rather than constructing a new one, otherwise all CLI
parsed options are lost.

On Sun, Nov 25, 2012 at 12:43 AM, L N <nklnarayana@gmail.com> wrote:
> Hi Harsh,
>
> I pasted the code in pastbin.com. Link is below.
>
> http://pastebin.com/eN1BXuWh
>
> To which DL , do I need to send these questions. Also, please let me
> know to which user list, my post is moved.  I could not find it.
>
> Thanks
> Lakshmi
>
> On Sat, Nov 24, 2012 at 3:02 AM, Harsh J <harsh@cloudera.com> wrote:
>> Can you please share your code over pastebin.com or GH gists so?
>>
>> Also, the mapreduce-dev@ address is for MR project development, not
>> user help. I've moved your question to the proper users list. Please
>> use that going forward :)
>>
>> On Sat, Nov 24, 2012 at 11:45 AM, L N <nklnarayana@gmail.com> wrote:
>>> Hi,
>>>
>>> I am trying to run a hadoop command
>>>
>>> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queue-name> input
output
>>>
>>> where input and output are directories.But I get the following error.
>>>
>>> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>>> arguments. Applications should implement Tool for the same.
>>> Exception in thread "main"
>>> org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory
>>> hdfs://.com/user/krishna/input already exists
>>>
>>> If you see it is taking input directory  as output and throwing output
>>> directory already exists.
>>>
>>> if I give below command
>>>
>>> hadoop jar lc.jar linecount -Dmapred.job.queue.name=<queuename> output
>>>
>>> I get below error.
>>>
>>> WARN mapred.JobClient: Use GenericOptionsParser for parsing the
>>> arguments. Applications should implement Tool for the same.
>>> Exception in thread "main"
>>> org.apache.hadoop.mapred.InvalidInputException: Input path does not
>>> exist: hdfs://com/user/krishna/-Dmapred.job.queue.name=<queuename>
>>>
>>> Looks like it is taking -Dmapred.job.queue.name=<queuename> as the
>>> input directory.
>>>
>>> Where am I doing wrong.
>>> I have implemented tool interface in main class.
>>>
>>>
>>> Thanks
>>> Lakshmi
>>
>>
>>
>> --
>> Harsh J



-- 
Harsh J

Mime
View raw message