hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shahab Yunus <shahab.yu...@gmail.com>
Subject Re: Passing Args to Mappers and Reducers
Date Tue, 06 Oct 2015 13:26:42 GMT
Are you properly implementing the Tool interface?
https://hadoopi.wordpress.com/2013/06/05/hadoop-implementing-the-tool-interface-for-mapreduce-driver/

Also, there needs to be space between -D and the param name.

Regards,
Shahab

On Tue, Oct 6, 2015 at 9:22 AM, Istabrak Abdul-Fatah <ifatah@gmail.com>
wrote:

> Greetings to all,
> Is it possible to pass args to Mapper and Reducers via the command line
> args.
> I need to pass some args upon the MapRed job invocation so that I can pass
> these args via the Context object to the Mapper and Reducer code.
> I am currently running Hadoop2.7 and tried to pass some args using the -D
> VM args but it did not succeed.
> Here are some failed code snippets:
>
> ~]$ yarn -Dista="666666" jar /opt/yarn/my_examples/AvgSix.jar
> /user/yarn/input/samplefile.csv output
>
> ~]$ yarn  jar -Dista="666666" /opt/yarn/my_examples/AvgSix.jar
> /user/yarn/input/samplefile.csv output
>
> ~]$ yarn  jar /opt/yarn/my_examples/AvgSix.jar
> /user/yarn/input/samplefile.csv output  -Dista="666666"
>
> Please advise.
>
>
> Thx and BR
>
> Ista
>

Mime
View raw message