Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CA+fHtaw5WBhXSQBEVzEM5DzAc04CpCL6iv5zT-ktADAsQX2Jxw@mail.gmail.com>
References: 
 <CA+fHtaw5WBhXSQBEVzEM5DzAc04CpCL6iv5zT-ktADAsQX2Jxw@mail.gmail.com>
Date: Fri, 26 Jun 2015 09:09:11 +0530
Message-ID: 
 <CALBaq-OS89zusVmfjrVAHcMEwPVc2B7eXK-no1DuY5GSkn_SBA@mail.gmail.com>
Subject: Re: how to assign unique ID (Long Value) in mapper
From: Harshit Mathur <mathursharp@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11c2b616b98e060519637b49

--001a11c2b616b98e060519637b49
Content-Type: text/plain; charset=UTF-8

Are there loops in your graph?


On Thu, Jun 25, 2015 at 10:39 PM, Ravikant Dindokar <ravikant.iisc@gmail.com
> wrote:

> Hi Hadoop user,
>
> I have a file containing one line for each edge in the graph with two
> vertex ids (source & sink).
> sample:
> 1    2 (here 1 is source and 2 is sink node for the edge)
> 1    5
> 2    3
> 4    2
> 4    3
> I want to assign a unique Id (Long value )to each edge i.e for each line
> of the file.
>
> How to ensure assignment of unique value in distributed mapper process?
>
> Note : File size is large, so using only one reducer is not feasible.
>
> Thanks
> Ravikant
>


-- 
Harshit Mathur

--001a11c2b616b98e060519637b49
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Are there loops in your graph?<br><br></div><div class=3D"=
gmail_extra"><br><div class=3D"gmail_quote">On Thu, Jun 25, 2015 at 10:39 P=
M, Ravikant Dindokar <span dir=3D"ltr">&lt;<a href=3D"mailto:ravikant.iisc@=
gmail.com" target=3D"_blank">ravikant.iisc@gmail.com</a>&gt;</span> wrote:<=
br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left=
:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div><div><div><div><div=
><div>Hi Hadoop user,<br><br></div>I have a file containing one line for ea=
ch edge in the graph with two vertex ids (source &amp; sink).<br>sample:<br=
><div>1=C2=A0=C2=A0=C2=A0 2 (here 1 is source and 2 is sink node for the ed=
ge)<br></div>1=C2=A0=C2=A0=C2=A0 5<br>2=C2=A0=C2=A0=C2=A0 3<br>4=C2=A0=C2=
=A0=C2=A0 2<br>4=C2=A0=C2=A0=C2=A0 3<br></div>I want to assign a unique Id =
(Long value )to each edge i.e for each line of the file.<br><br></div>How t=
o ensure assignment of unique value in distributed mapper process?<br><br><=
/div>Note : File size is large, so using only one reducer is not feasible.<=
br><br></div>Thanks<span class=3D"HOEnZb"><font color=3D"#888888"><br></fon=
t></span></div><span class=3D"HOEnZb"><font color=3D"#888888">Ravikant<br><=
/font></span></div>
</blockquote></div><br><br clear=3D"all"><br>-- <br><div class=3D"gmail_sig=
nature">Harshit Mathur</div>
</div>

--001a11c2b616b98e060519637b49--