hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kishore Bonagiri <write2kish...@gmail.com>
Subject Re: Differences hadoop-2.0.0-alpha Vs hadoop-2.0.3-alpha
Date Fri, 29 Mar 2013 09:32:42 GMT
Hi Arun,

  I had to change the way I get queueInfo in Client.java

from
    GetQueueInfoRequest queueInfoReq =
Records.newRecord(GetQueueInfoRequest.class);
    GetQueueInfoResponse queueInfoResp =
applicationsManager.getQueueInfo(queueInfoReq);
    QueueInfo queueInfo = queueInfoResp.getQueueInfo();

to
    boolean includeApplications = true, includeChildQueues = false,
recursive = false;
    String queueName = "default";

    GetQueueInfoRequest request =
Records.newRecord(GetQueueInfoRequest.class);
    request.setQueueName(queueName);
    request.setIncludeApplications(includeApplications);
    request.setIncludeChildQueues(includeChildQueues);
    request.setRecursive(recursive);

    QueueInfo queueInfo =
applicationsManager.getQueueInfo(request).getQueueInfo();

I could make it work with these changes.

And, one more important thing is I am observing a huge delay in allocation
of containers. I allocate 13 containers for my application, and it now
takes 13 seconds for getting them allocated where as with 2.0.0-alpha I
used to get them allocated like in a second or two on my system. Can you
please throw me some clue if there is a way to improve or if I could be
doing something wrong..

Thanks,
Kishore




On Thu, Mar 28, 2013 at 2:39 AM, Arun C Murthy <acm@hortonworks.com> wrote:

> YarnClient etc. is a just a bunch of helper libs to make it easier to
> write new applications.
>
> OTOH, your existing application should continue to work.
>
> hth,
> Arun
>
> On Mar 26, 2013, at 3:21 AM, Krishna Kishore Bonagiri wrote:
>
> Hi,
>   I  have some YARN application written and running properly against
> hadoop-2.0.0-alpha but when I recently downloaded and started using
> hadoop-2.0.3-alpha it doesn't work. I think the original one I wrote was
> looking at the Client.java and ApplicationMaster.java in DistributedShell
> example. It looks like this example code also has changed with the new
> version, it now has the Client being extended from YarnClientImpl and many
> other changes it has.
>
>   Is there any guide as to how should I modify my old application to work
> against the new version?
>
> Thanks,
> Kishore
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>

Mime
View raw message