Return-Path: X-Original-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-giraph-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5A7B09655 for ; Wed, 1 Feb 2012 06:03:23 +0000 (UTC) Received: (qmail 60584 invoked by uid 500); 1 Feb 2012 06:03:22 -0000 Delivered-To: apmail-incubator-giraph-user-archive@incubator.apache.org Received: (qmail 60538 invoked by uid 500); 1 Feb 2012 06:03:17 -0000 Mailing-List: contact giraph-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: giraph-user@incubator.apache.org Delivered-To: mailing list giraph-user@incubator.apache.org Received: (qmail 60529 invoked by uid 99); 1 Feb 2012 06:03:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 06:03:15 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jghoman@gmail.com designates 74.125.82.175 as permitted sender) Received: from [74.125.82.175] (HELO mail-we0-f175.google.com) (74.125.82.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Feb 2012 06:03:08 +0000 Received: by werc1 with SMTP id c1so779460wer.6 for ; Tue, 31 Jan 2012 22:02:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=+xbYTBtPnJcXGoomz/5qk0P+ZDuGAGhju8wD1YrCt9c=; b=UtwdteY1ZIG6D/kQf1lmzhIBw3a+Taar+VEZ7bcvxber0PwOJ7eM2yGrRUcgzYptWN yWf3VeYDBtu5z233+2aacXP3xgnFLhWWzuleJCcR/XLu+uCXQXkZoIWpHNr8387mG6UQ qEnH0o8FwUQxVV9ZATO4vJJjl19onnLQJlJUA= Received: by 10.216.135.35 with SMTP id t35mr10127757wei.9.1328076168218; Tue, 31 Jan 2012 22:02:48 -0800 (PST) MIME-Version: 1.0 Received: by 10.180.107.166 with HTTP; Tue, 31 Jan 2012 22:02:18 -0800 (PST) In-Reply-To: References: From: Jakob Homan Date: Tue, 31 Jan 2012 22:02:18 -0800 Message-ID: Subject: Re: Caching (with LRU or something) strategy in Giraph? To: giraph-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org David- Please take a look at GIRAPH-45 for this discussion. -Jakob On Tue, Jan 31, 2012 at 9:34 PM, David Garcia w= rote: > I haven't investigated too deeply into this. . .but is there a caching > strategy implemented, or in the works, for getting around having to load = all > of a split's vertices into memory? =A0If a graph is large enough, even a > reasonably sized cluster may not have enough memory to load all the > vertices. =A0Does Giraph address this currently? > > -David