Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAHNHubaGoOtbqZswhv_Dv2bVx8LjJqOX38c3yHJw9xwdDCFxkw@mail.gmail.com>
References: 
 <CAHNHubaGoOtbqZswhv_Dv2bVx8LjJqOX38c3yHJw9xwdDCFxkw@mail.gmail.com>
Date: Thu, 8 Oct 2015 21:40:08 -0700
Message-ID: 
 <CAHNHubbOFwN0AyaHkkWqHsSvC3nHM1ypKpR1ar3p9F1MHnpdiQ@mail.gmail.com>
Subject: Re: Specify start and end range for Tasks Api
From: manoj <manojm.321@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a1141aebc0d56bc0521a49395

--001a1141aebc0d56bc0521a49395
Content-Type: text/plain; charset=UTF-8

Any suggestions on the following query?

Thanks,
Manoj
On Oct 1, 2015 2:54 PM, "manoj" <manojm.321@gmail.com> wrote:

> Hello All,
>
>
> I'm using the following API to get all the tasks relating to a job. The
> problem is, if the number of tasks are in say 1million range then the data
> returned by this api is too huge to store in memory before I process the
> data and save it.
>
> I was wondering if I can specify a range say: start and end of taskID and
> get only 1K task at a time.
> Basically I want to chop down the day instead of getting all at once.
>
> http://<history server http address:port>/ws/v1/history/mapreduce/jobs/{jobid}/tasks
>
>
> Thanks,
> --Manoj Kumar M
>

--001a1141aebc0d56bc0521a49395
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<p dir=3D"ltr">Any suggestions on the following query?</p>
<p dir=3D"ltr">Thanks,<br>
Manoj<br>
</p>
<div class=3D"gmail_quote">On Oct 1, 2015 2:54 PM, &quot;manoj&quot; &lt;<a=
 href=3D"mailto:manojm.321@gmail.com">manojm.321@gmail.com</a>&gt; wrote:<b=
r type=3D"attribution"><blockquote class=3D"gmail_quote" style=3D"margin:0 =
0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hell=
o All,<div><br></div><div><br></div><div>I&#39;m using the following API to=
 get all the tasks relating to a job. The problem is, if the number of task=
s are in say 1million range then the data returned by this api is too huge =
to store in memory before I process the data and save it.</div><div><br></d=
iv><div>I was wondering if I can specify a range say: start and end of task=
ID and get only 1K task at a time.</div><div>Basically I want to chop down =
the day instead of getting all at once.</div><div><br></div><div><pre style=
=3D"color:rgb(0,0,0);font-size:13px">http://&lt;history server http address=
:port&gt;/ws/v1/history/mapreduce/jobs/{jobid}/tasks</pre><div><br></div>Th=
anks,</div><div><div><div dir=3D"ltr">--Manoj Kumar M</div></div>
</div></div>
</blockquote></div>

--001a1141aebc0d56bc0521a49395--