hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: Passing data from Client to AM
Date Wed, 29 Jan 2014 22:25:31 GMT
Command line arguments & env variables are the most direct options.

A more onerous option is to write some data to a file in HDFS, use LocalResource to ship it
to the container on each node and get application code to read that file locally. (In MRv1
parlance that is "Distributed Cache").


On Jan 29, 2014, at 12:59 PM, Brian C. Huffman <bhuffman@etinternational.com> wrote:

> I'm looking at Distributed Shell as an example for writing a YARN application.
> My question is why are the script path and associated metadata saved as environment variables?
 Are there any other ways besides environment variables or command line arguments for passing
data from the Client to the ApplicationMaster?
> Thanks,
> Brian

Arun C. Murthy
Hortonworks Inc.

NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

View raw message