Return-Path: X-Original-To: apmail-hama-dev-archive@www.apache.org Delivered-To: apmail-hama-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8584410928 for ; Thu, 16 Jan 2014 10:11:06 +0000 (UTC) Received: (qmail 70985 invoked by uid 500); 16 Jan 2014 10:11:06 -0000 Delivered-To: apmail-hama-dev-archive@hama.apache.org Received: (qmail 70864 invoked by uid 500); 16 Jan 2014 10:11:04 -0000 Mailing-List: contact dev-help@hama.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hama.apache.org Delivered-To: mailing list dev@hama.apache.org Received: (qmail 70840 invoked by uid 99); 16 Jan 2014 10:11:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Jan 2014 10:11:03 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of tommaso.teofili@gmail.com designates 209.85.192.169 as permitted sender) Received: from [209.85.192.169] (HELO mail-pd0-f169.google.com) (209.85.192.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 16 Jan 2014 10:10:59 +0000 Received: by mail-pd0-f169.google.com with SMTP id v10so2423441pde.0 for ; Thu, 16 Jan 2014 02:10:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=Wifydr4Q1mlOhxdH7o7mxhyTAso9JoY5YaZuDvXrVIU=; b=aHNRRKecY+/v2EB7BwQEbZeDxsYBhq47OIn1RzsnIJeTqb4ZmIGw/v3tEwFduyjoAu kj3Jn6uJ84u46Kj6Arf5C3KWvIm9eV2/xSlYHHL/tXUa266ziaM20qw3tEgfdgGCvzle Ee6PVMRaCY/7zdoCCdvz0ff4+s8YqpVr7+86qYHf4/tNpAXoNcVyJe5gOJxPJhqCgGrC NbZloCHoCqGQN7je1nwixhTLc30LsJLVqPBo//FlVQBGMpc5s52MXpVZO+hJOYAtd1oG 17EpjfewKKtsFO4vJqTNKgmeqeYmcBVzJIGQzK62aF5eKgkdGKMEFUy6Bp4xeT/0Tzk9 NLgA== X-Received: by 10.68.131.202 with SMTP id oo10mr8841159pbb.35.1389867039298; Thu, 16 Jan 2014 02:10:39 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.213.163 with HTTP; Thu, 16 Jan 2014 02:09:59 -0800 (PST) In-Reply-To: References: <1389709117.72363.YahooMailNeo@web162001.mail.bf1.yahoo.com> From: Tommaso Teofili Date: Thu, 16 Jan 2014 11:09:59 +0100 Message-ID: Subject: Re: loading vertices into RAM To: dev@hama.apache.org Content-Type: multipart/alternative; boundary=001a11c3611c299a9f04f013a379 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c3611c299a9f04f013a379 Content-Type: text/plain; charset=ISO-8859-1 of course you would also need to add DirectMemory [1][2] (core and kryo modules) to the classpath (e.g. if you're triggering jobs by scripts). Tommaso [1] : http://repo1.maven.org/maven2/org/apache/directmemory/directmemory-cache/0.2/directmemory-cache-0.2.jar [2] : http://repo1.maven.org/maven2/org/apache/directmemory/directmemory-kryo/0.2/directmemory-kryo-0.2.jar 2014/1/16 Tommaso Teofili > it's in hama-graph 0.6.3 [1]. > > Tommaso > > > [1] : > http://grepcode.com/file/repo1.maven.org$maven2@org.apache.hama$hama-graph@0.6.3@org$apache$hama$graph$OffHeapVerticesInfo.java > > > 2014/1/15 Edward J. Yoon > >> Today I tried to use off-heap vertices info but it throws Class not >> found exceptions. :/ Which jar need to be included to use it? >> >> On Wed, Jan 15, 2014 at 3:59 PM, Tommaso Teofili >> wrote: >> > and OffHeapVerticesInfo for loading vertices off heap, which is >> available >> > with 0.6.3 as well if I recall correctly. >> > Tommaso >> > >> > >> > 2014/1/15 Edward J. Yoon >> > >> >> There are few implementations. >> >> >> >> - ListVerticesinfo: loads vertices into array list. >> >> - MapVerticesinfo: loads vertices into tree map. >> >> - DiskVerticesInfo: loads vertices into a local file. >> >> >> >> You can choose one of them by setting the "hama.graph.vertices.info" >> >> in job configuration. >> >> >> >> > conf.setClass("hama.graph.vertices.info", >> >> "org.apache.hama.graph.ListVerticesInfo". >> >> >> >> With the latest 0.6.3 version, you can use only ListVerticesInfo. >> >> Please use the TRUNK. >> >> >> >> >> >> On Tue, Jan 14, 2014 at 11:18 PM, Ammar Sahib >> >> wrote: >> >> > Hi >> >> > >> >> > According to the BSP model, the data is processed in the RAM and >> that is >> >> the reason why Pregel model is faster than the MapReduce (MapReduce >> >> writedown to disk). Can someone explains to me how to be sure that all >> the >> >> graph vertices are actually been loaded in RAM? >> >> > >> >> > >> >> > How would HAMA behave if the vertices values are so big such that the >> >> available RAM memory is not enough to contains all of the vertices? >> >> > >> >> > Regards >> >> >> >> >> >> >> >> -- >> >> Best Regards, Edward J. Yoon >> >> @eddieyoon >> >> >> >> >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> > > --001a11c3611c299a9f04f013a379--