Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BA76418BDC for ; Fri, 26 Jun 2015 07:41:28 +0000 (UTC) Received: (qmail 89913 invoked by uid 500); 26 Jun 2015 07:41:23 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 89803 invoked by uid 500); 26 Jun 2015 07:41:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 89793 invoked by uid 99); 26 Jun 2015 07:41:22 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Jun 2015 07:41:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4673F1A611B for ; Fri, 26 Jun 2015 07:41:22 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id j_HFP-y33KJu for ; Fri, 26 Jun 2015 07:41:21 +0000 (UTC) Received: from mail-lb0-f173.google.com (mail-lb0-f173.google.com [209.85.217.173]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 2ED302092B for ; Fri, 26 Jun 2015 07:41:21 +0000 (UTC) Received: by lbbpo10 with SMTP id po10so59338425lbb.3 for ; Fri, 26 Jun 2015 00:41:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=P5SadUi72B2Evvj+Kn/nY4Sy89w9YHgbf+6IekThOis=; b=TVqvnKGnCXqAkVVDkELvVSM8n+1HKBqh/g7zP7DGatH93SV4+sgUJOvJ1QP6ezj2M1 vh+3DLy7gRTT3ocLy51Byd53aD5jpR49YqfTFToRpUL665GKtjnfIgyjobHOHV97zc+X wqE7kIiaQm4Q3cHUlxKjYi7fu5WoQbYXAND5/g5jupNT+koDpBTnGTb+u8fsoFnfQGRw GhoFxtE94q+wi2It++4bcMQ8Bzn4xQOb/jpCTXDHJrBNwH4XHr5QRllrGB6DoT7MEmWq V7QEU/Kth7nIbmG5ddNTshI+Z8xEr06Hg44FAT1sGm6u0KRmMtxZWVhg8uYQAV27dQJ+ 6clw== MIME-Version: 1.0 X-Received: by 10.152.27.1 with SMTP id p1mr281784lag.112.1435304479703; Fri, 26 Jun 2015 00:41:19 -0700 (PDT) Received: by 10.25.78.13 with HTTP; Fri, 26 Jun 2015 00:41:19 -0700 (PDT) In-Reply-To: References: Date: Fri, 26 Jun 2015 13:11:19 +0530 Message-ID: Subject: Re: how to assign unique ID (Long Value) in mapper From: Ravikant Dindokar To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e0158cb32a848e9051966ddd2 --089e0158cb32a848e9051966ddd2 Content-Type: text/plain; charset=UTF-8 yes , there can be loop in the graph On Fri, Jun 26, 2015 at 9:09 AM, Harshit Mathur wrote: > Are there loops in your graph? > > > On Thu, Jun 25, 2015 at 10:39 PM, Ravikant Dindokar < > ravikant.iisc@gmail.com> wrote: > >> Hi Hadoop user, >> >> I have a file containing one line for each edge in the graph with two >> vertex ids (source & sink). >> sample: >> 1 2 (here 1 is source and 2 is sink node for the edge) >> 1 5 >> 2 3 >> 4 2 >> 4 3 >> I want to assign a unique Id (Long value )to each edge i.e for each line >> of the file. >> >> How to ensure assignment of unique value in distributed mapper process? >> >> Note : File size is large, so using only one reducer is not feasible. >> >> Thanks >> Ravikant >> > > > > -- > Harshit Mathur > --089e0158cb32a848e9051966ddd2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
yes , there can be loop in the graph

On Fri, Jun 26, 2015 at 9:0= 9 AM, Harshit Mathur <mathursharp@gmail.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">
Are there loops in your grap= h?


On Thu, Jun 25, 2015 at 10:39 PM, Ravikant Dindokar <= span dir=3D"ltr"><ravikant.iisc@gmail.com> wrote:
Hi Hadoop user= ,

I have a file containing one line for each edge in the graph= with two vertex ids (source & sink).
sample:
1=C2=A0=C2=A0= =C2=A0 2 (here 1 is source and 2 is sink node for the edge)
1=C2= =A0=C2=A0=C2=A0 5
2=C2=A0=C2=A0=C2=A0 3
4=C2=A0=C2=A0=C2=A0 2
4=C2= =A0=C2=A0=C2=A0 3
I want to assign a unique Id (Long value )to eac= h edge i.e for each line of the file.

How to ensure assignment= of unique value in distributed mapper process?

Note : File si= ze is large, so using only one reducer is not feasible.

Thanks=
Ravikant



--
Harshit Mathur

--089e0158cb32a848e9051966ddd2--