hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harshit Mathur <mathursh...@gmail.com>
Subject Re: how to assign unique ID (Long Value) in mapper
Date Fri, 26 Jun 2015 03:39:11 GMT
Are there loops in your graph?


On Thu, Jun 25, 2015 at 10:39 PM, Ravikant Dindokar <ravikant.iisc@gmail.com
> wrote:

> Hi Hadoop user,
>
> I have a file containing one line for each edge in the graph with two
> vertex ids (source & sink).
> sample:
> 1    2 (here 1 is source and 2 is sink node for the edge)
> 1    5
> 2    3
> 4    2
> 4    3
> I want to assign a unique Id (Long value )to each edge i.e for each line
> of the file.
>
> How to ensure assignment of unique value in distributed mapper process?
>
> Note : File size is large, so using only one reducer is not feasible.
>
> Thanks
> Ravikant
>



-- 
Harshit Mathur

Mime
View raw message