Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id CEEC4200C73 for ; Wed, 10 May 2017 17:35:20 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id CBD9D160BA8; Wed, 10 May 2017 15:35:20 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 1E8F9160B9C for ; Wed, 10 May 2017 17:35:19 +0200 (CEST) Received: (qmail 37309 invoked by uid 500); 10 May 2017 15:35:19 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 37299 invoked by uid 99); 10 May 2017 15:35:19 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 May 2017 15:35:19 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 9D70E180158 for ; Wed, 10 May 2017 15:35:18 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.129 X-Spam-Level: ** X-Spam-Status: No, score=2.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id SaS8c_eZxr_k for ; Wed, 10 May 2017 15:35:15 +0000 (UTC) Received: from mail-pg0-f45.google.com (mail-pg0-f45.google.com [74.125.83.45]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id CE0F55F27E for ; Wed, 10 May 2017 15:35:14 +0000 (UTC) Received: by mail-pg0-f45.google.com with SMTP id u28so18542283pgn.1 for ; Wed, 10 May 2017 08:35:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=qvfQA53W3QHw2/PoHjjbgijsyAWPtL10KYD0Q1aQp+o=; b=fsCZ6eyaqOVSJxePyOzV+ZomfcER6uknc58JWvtKHERsbYgjE6Dg4J7EMo5qrUo18g agKC+W5H+INscC0U6tWuoYQKRuPAqpOIA6gyBEb41xn5UzQZfimOtxmEqctI0xvYkn03 iyG12zt2fjA4+RRjLqz9RGS5gK7lOxKNxLJGV+SviS1Ka+RqzbMLVyVfSiwb+RX4M3jH lTMCilHE/l9RHcWBurgcoHNClF5PR7biIOB709Wef07ZeTbD/BHO+75TfTOqSYCV5rH+ 88LxVsZwLIcYsz07eAorGkoHweEhe4WKljfhaoX8psnKvxiLCnXFjzOdKz/9llGkCuYc 28Fg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=qvfQA53W3QHw2/PoHjjbgijsyAWPtL10KYD0Q1aQp+o=; b=VKoEaNUIJQG/KUJ9z76d1jN/Io+fRyu7kHfwLJQgTN7e2dkJSzfkqYVlv20Xn19Hro Mly4ioApidJPc5LjCLMX44+Qs3qN3l6viRpVJQtSv+nWyQ6dHdTXfInn1j9jFc4C9maE bzJ/CqF8gHpkZT+UztaMjl4ORYUktj23kyRUR+rtyB5jKdsnIAbdGLapNMvVwqAxpPX5 a4rb4IKqN8xjD9Yp+wKY5O0HALY0CEn9LXGH2Ib7iGO2KYDjMKvv18wUA0PTtYa8DU/c gGjzo4aQlYzOg0AJbAWibXfJHf4b2xGtdHoJsKDy3Ux008Dey2farqWneWQ0nzto2LzV 4z6w== X-Gm-Message-State: AODbwcBQFHb4sH/yR3t8cRldsS3QXOOzgtc0l1w5N1R0wNIOBV/pxAc/ PbOAXhG1Wk2m70+Z8Us4HFX6eQvoJYEt X-Received: by 10.99.107.198 with SMTP id g189mr7006395pgc.162.1494430513811; Wed, 10 May 2017 08:35:13 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.128.199 with HTTP; Wed, 10 May 2017 08:35:13 -0700 (PDT) From: Guillermo Ortiz Date: Wed, 10 May 2017 17:35:13 +0200 Message-ID: Subject: Sizing in Ignite To: user@ignite.apache.org Content-Type: multipart/alternative; boundary=94eb2c140702eada2e054f2d3762 archived-at: Wed, 10 May 2017 15:35:21 -0000 --94eb2c140702eada2e054f2d3762 Content-Type: text/plain; charset=UTF-8 What's the reason because it needs so many space Ignite to store data in memory?. For example, if your dataset it's about 4TB and you are going to use backup (1 replica) the final size it's about 5TBx2.5x1.3(indices) x backcup = 26TB more or less... So, it could be 28TB with the memory of the system to work. It seems insane to have that memory in many cases. How does Ignite store data to spend 3 times the size on disk? is it possible to reduce this? --94eb2c140702eada2e054f2d3762 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
What's the reason because it needs so many space Ignit= e to store data in memory?.=C2=A0
For example, if your dataset it's= about 4TB and you are going to use backup (1 replica) the final size it= 9;s about

5TBx2.5x1.3(indices) x backcup =3D 26TB = more or less... So, it could be 28TB with the memory of the system to work.= =C2=A0

It seems insane to have that memory in many= cases. How does Ignite store data to spend 3 times the size on disk? is it= possible to reduce this?
--94eb2c140702eada2e054f2d3762--