Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7541E18961 for ; Wed, 17 Jun 2015 05:02:46 +0000 (UTC) Received: (qmail 67975 invoked by uid 500); 17 Jun 2015 05:02:46 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 67895 invoked by uid 500); 17 Jun 2015 05:02:46 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 67885 invoked by uid 99); 17 Jun 2015 05:02:46 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 17 Jun 2015 05:02:46 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id AB62AC0953 for ; Wed, 17 Jun 2015 05:02:45 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.02 X-Spam-Level: X-Spam-Status: No, score=-0.02 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id xPWgrq7oGg6v for ; Wed, 17 Jun 2015 05:02:45 +0000 (UTC) Received: from mail-wi0-f173.google.com (mail-wi0-f173.google.com [209.85.212.173]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 7A4B6261A6 for ; Wed, 17 Jun 2015 05:02:44 +0000 (UTC) Received: by wibdq8 with SMTP id dq8so39673613wib.1 for ; Tue, 16 Jun 2015 22:01:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=message-id:date:from:reply-to:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=AJ4dxinfpmiZClKi1S+shEua4QXpQJ6DSxHgVMUulo0=; b=Titp+vaF8l2y+bQ8losIt9AfZzRcNLljwmf41vWrlA1DipqFQe54yVCRrWlB5Yugzg l6XioIvKymmuq9SzGJ31c3TGzuA7fLJKFFIcyZYmAF7XsnYV5g2F1Y3rEy6zsLf9MUUL CV4wTdrTaUF6pRW0pYAZmOM898Z4XYI/inQ2AGhW1du49enTNxHAr3MzjQSHiEKR1xmL fX5UbDsgHEtUdpZFbdxMdSsV1nFCcGbQcfOPn4vdzr1dWo7ToSZgj3Fpf1OUyW490U3m NdX+wDcw69njOoX1FyBKY/jRC9ORQ842fFq3tFEl1cRTctZjdRjlqLcTFbKUFi1aBA9e SvJA== X-Received: by 10.194.200.194 with SMTP id ju2mr2092598wjc.61.1434517318045; Tue, 16 Jun 2015 22:01:58 -0700 (PDT) Received: from [192.168.0.2] (x55b3ad45.dyn.telefonica.de. [85.179.173.69]) by mx.google.com with ESMTPSA id o6sm23927153wiz.24.2015.06.16.22.01.56 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 16 Jun 2015 22:01:57 -0700 (PDT) Message-ID: <5580FF43.5040306@apache.org> Date: Wed, 17 Jun 2015 07:01:55 +0200 From: Sebastian Reply-To: ssc@apache.org User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: user@flink.apache.org Subject: Memory in local setting Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, Flink has memory problems when I run an algorithm from my local IDE on a 2GB graph. Is there any way that I can increase the memory given to Flink? Best, Sebastian Caused by: java.lang.RuntimeException: Memory ran out. numPartitions: 32 minPartition: 4 maxPartition: 4 number of overflow segments: 151 bucketSize: 146 Overall memory: 14024704 Partition memory: 4194304 at org.apache.flink.runtime.operators.hash.CompactingHashTable.getNextBuffer(CompactingHashTable.java:784) at org.apache.flink.runtime.operators.hash.CompactingHashTable.insertBucketEntryFromSearch(CompactingHashTable.java:668) at org.apache.flink.runtime.operators.hash.CompactingHashTable.insertOrReplaceRecord(CompactingHashTable.java:538) at org.apache.flink.runtime.operators.hash.CompactingHashTable.buildTableWithUniqueKey(CompactingHashTable.java:347) at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.readInitialSolutionSet(IterationHeadPactTask.java:209) at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:270) at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) at java.lang.Thread.run(Thread.java:745)