Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of manoj444@gmail.com designates
 209.85.161.176 as permitted sender)
MIME-Version: 1.0
From: Manoj Babu <manoj444@gmail.com>
Date: Mon, 13 Aug 2012 15:42:19 +0530
Message-ID: 
 <CACvfG=oE0C6MZPEDX8zY-H=R0dg4Nxh-LHNzvDvb6doLOF0dYQ@mail.gmail.com>
Subject: doubt on Hadoop job submission process
To: mapreduce-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b15b139041ae404c722efed

--047d7b15b139041ae404c722efed
Content-Type: text/plain; charset=ISO-8859-1

Hi All,

Normal Hadoop job submission process involves:

   1. Checking the input and output specifications of the job.
   2. Computing the
InputSplit<http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/mapred/InputSplit.html>s
   for the job.
   3. Setup the requisite accounting information for the
DistributedCache<http://hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/filecache/DistributedCache.html>
of
   the job, if necessary.
   4. Copying the job's jar and configuration to the map-reduce system
   directory on the distributed file-system.
   5. Submitting the job to the JobTracker and optionally monitoring it's
   status.

I have a doubt in 4th point of  job execution flow could any of you explain
it?

   - What is job's jar?
   - Is it job's jar is the one we submitted to hadoop or hadoop will build
   based on the job configuration object?


Cheers!
Manoj.

--047d7b15b139041ae404c722efed
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div>Hi All,</div><div><br></div><div><span style=3D"font-family:&#39;Times=
 New Roman&#39;;font-size:medium">Normal Hadoop job submission process invo=
lves:</span></div><div><ol style=3D"font-family:&#39;Times New Roman&#39;;f=
ont-size:medium">

<li>Checking the input and output specifications of the job.</li><li>Comput=
ing the=A0<a href=3D"http://hadoop.apache.org/common/docs/r0.20.2/api/org/a=
pache/hadoop/mapred/InputSplit.html" title=3D"interface in org.apache.hadoo=
p.mapred"><code>InputSplit</code></a>s for the job.</li>

<li>Setup the requisite accounting information for the=A0<a href=3D"http://=
hadoop.apache.org/common/docs/r0.20.2/api/org/apache/hadoop/filecache/Distr=
ibutedCache.html" title=3D"class in org.apache.hadoop.filecache"><code>Dist=
ributedCache</code></a>=A0of the job, if necessary.</li>

<li>Copying the job&#39;s jar and configuration to the map-reduce system di=
rectory on the distributed file-system.</li><li>Submitting the job to the=
=A0<code>JobTracker</code>=A0and optionally monitoring it&#39;s status.</li=
>
</ol>
</div><div>I have a doubt in 4th point of =A0job execution flow could any o=
f you explain it?
</div><div><ul><li>What is job&#39;s jar?</li><li>Is it job&#39;s jar is th=
e one we submitted to hadoop or hadoop will build based on the job configur=
ation object?=A0</li></ul></div><div><br></div><br clear=3D"all">Cheers!<di=
v>

Manoj.</div><br>

--047d7b15b139041ae404c722efed--