Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
MIME-Version: 1.0
From: manoj <manojm.321@gmail.com>
Date: Thu, 1 Oct 2015 14:54:18 -0700
Message-ID: 
 <CAHNHubaGoOtbqZswhv_Dv2bVx8LjJqOX38c3yHJw9xwdDCFxkw@mail.gmail.com>
Subject: Specify start and end range for Tasks Api
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c25358eb528c0521121727

--001a11c25358eb528c0521121727
Content-Type: text/plain; charset=UTF-8

Hello All,


I'm using the following API to get all the tasks relating to a job. The
problem is, if the number of tasks are in say 1million range then the data
returned by this api is too huge to store in memory before I process the
data and save it.

I was wondering if I can specify a range say: start and end of taskID and
get only 1K task at a time.
Basically I want to chop down the day instead of getting all at once.

http://<history server http
address:port>/ws/v1/history/mapreduce/jobs/{jobid}/tasks


Thanks,
--Manoj Kumar M

--001a11c25358eb528c0521121727
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hello All,<div><br></div><div><br></div><div>I&#39;m using=
 the following API to get all the tasks relating to a job. The problem is, =
if the number of tasks are in say 1million range then the data returned by =
this api is too huge to store in memory before I process the data and save =
it.</div><div><br></div><div>I was wondering if I can specify a range say: =
start and end of taskID and get only 1K task at a time.</div><div>Basically=
 I want to chop down the day instead of getting all at once.</div><div><br>=
</div><div><pre style=3D"color:rgb(0,0,0);font-size:13px">http://&lt;histor=
y server http address:port&gt;/ws/v1/history/mapreduce/jobs/{jobid}/tasks</=
pre><div><br></div>Thanks,</div><div><div class=3D"gmail_signature"><div di=
r=3D"ltr">--Manoj Kumar M</div></div>
</div></div>

--001a11c25358eb528c0521121727--