hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: YARN - specify hosts in ContainerRequest
Date Fri, 12 Apr 2013 01:39:29 GMT
There shouldn't be issues handling nulls etc. - obviously depends on scheduler, but if you
see any we will fix it ASAP.

On Apr 12, 2013, at 12:20 AM, Harsh J wrote:

> Hi Brian,
> 
> Your way of creation seems fine. Are you "adding" this to the
> AMRMClient somewhere though, via [1], right before you call
> allocate(progress)? Cause otherwise this object's not used at all.
> 
> P.s. I'm not sure we'll handle that null for racks all that well in
> certain places yet; I've noticed errors in my app when I've missed
> passing elements or passed them as nulls, but I didn't rebase it onto
> 2.0.3 yet so haven't reported anything so far - will do so soon. I'd
> check the RM log to see if there's any WARN logged there with an NPE.
> 
> [1] - http://hadoop.apache.org/docs/current/api/org/apache/hadoop/yarn/client/AMRMClient.html#addContainerRequest(org.apache.hadoop.yarn.client.AMRMClient.ContainerRequest)
> 
> On Thu, Apr 11, 2013 at 11:30 PM, Brian C. Huffman
> <bhuffman@etinternational.com> wrote:
>> All,
>> 
>> I'm starting to work with YARN and I'm trying to make some changes to the
>> distributedshell example.
>> 
>> Specifically I'm trying to set the host where the distributed shell
>> container will run.  I added the following code into ApplicationMaster.java:
>>    final String[] containerNodes = { "node1" };
>> 
>>    LOG.info("Trying to request node: " + containerNodes[0]);
>>    ContainerRequest request = new ContainerRequest(capability,
>> containerNodes, null,
>>        pri, numContainers);
>> 
>> And while the log output shows this code is being executed ("Trying to
>> request..."), it doesn't seem to use it.  Is this functionality that isn't
>> complete yet in the 2.0.3 yarn alpha?  Or am I doing something wrong?
>> 
>> Thanks,
>> Brian
>> 
> 
> 
> 
> -- 
> Harsh J

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/



Mime
View raw message