Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 22304200BDC for ; Wed, 30 Nov 2016 00:17:45 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 20C49160B23; Tue, 29 Nov 2016 23:17:45 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6B74B160B15 for ; Wed, 30 Nov 2016 00:17:44 +0100 (CET) Received: (qmail 67853 invoked by uid 500); 29 Nov 2016 23:17:43 -0000 Mailing-List: contact dev-help@asterixdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.apache.org Delivered-To: mailing list dev@asterixdb.apache.org Received: (qmail 67827 invoked by uid 99); 29 Nov 2016 23:17:43 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Nov 2016 23:17:43 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B3D78C18C6 for ; Tue, 29 Nov 2016 23:17:42 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.48 X-Spam-Level: ** X-Spam-Status: No, score=2.48 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=uci-edu.20150623.gappssmtp.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 8YallDYP5teo for ; Tue, 29 Nov 2016 23:17:40 +0000 (UTC) Received: from mail-oi0-f53.google.com (mail-oi0-f53.google.com [209.85.218.53]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id A7CCB5FC7D for ; Tue, 29 Nov 2016 23:17:40 +0000 (UTC) Received: by mail-oi0-f53.google.com with SMTP id w63so210278223oiw.0 for ; Tue, 29 Nov 2016 15:17:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uci-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=T2eksXmIB3eQKN51QaQEILTH3mSMD4uf2Y+gpQPQEeU=; b=vnKtr9q9Znrzad3k5JeTUhJHLG4pMl+QzQzZ4gefy2Vv4TYBKfxhu2l+pkYBA/9RjN uQsItpgoVE2umyw/Vjc8OMypNRTx05I1s2jy8MOi93jCMP6A0BNr4uxw3SK4L6fXtlw2 rT1fhz+LLKtSqKUa04W+5QB34Bs8UqpZt5CaGT3xO6jOWAiDUb/pA/vwRe+YFVVRrphA 5X7Znll4Cf1kDXh72AsjRXC24O6eyrTij+S4gTT4i9N1Q4t7B85TNPN8+dsjRfXqdzUC +qlv3x30OLrNGnkWAzPuCzQX1CO4psgATjTjRCqq3Obn8aUJKWlb9LORJW1LpPNNaa30 q2Mw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=T2eksXmIB3eQKN51QaQEILTH3mSMD4uf2Y+gpQPQEeU=; b=BUx9Do+55GnCX0UWiMPHmfPyMwNc8DD2+aRwifyw6m30mTiZEkWF4L1xm50OW+okSG /BFEEkCFNBpGu51es1YpF9NZfjraphhOQdJCvRbKnIw5jRyHzxSB0KZnJgLGTCISqi/t Rbh1XOmeCKFAhhGC2VW4U/UZ8g1/zCRFpKHQGLoxhAwblL31gig8VMJaq7tflu8Im+BZ XfIBZopGDz0McuhULs7+qZsZv8oeTIeSaMXRJfKfF4u16geZ9az3HU9rfaLHHqq7ZwPD IadPN8/tdBygsUQGRLZ5q0J5vLlR1dh3QMJt0mYdl8c0SAnKKMnFG/9664qUe4t/oTxP ZmBw== X-Gm-Message-State: AKaTC03BCI5xKTNaw8uD88yWN4sCH2S2yB0/mSLWobA6y361V7ct7DEPPao04gDaxre75FEOtpVlrGDT6ZTeSQ== X-Received: by 10.202.78.140 with SMTP id c134mr15102623oib.198.1480461453382; Tue, 29 Nov 2016 15:17:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.157.52.193 with HTTP; Tue, 29 Nov 2016 15:17:12 -0800 (PST) From: Ian Maxon Date: Tue, 29 Nov 2016 15:17:12 -0800 Message-ID: Subject: Dev notes about storage file/folder layouts To: dev@asterixdb.incubator.apache.org Content-Type: multipart/alternative; boundary=001a11c160f6086b26054278cb76 archived-at: Tue, 29 Nov 2016 23:17:45 -0000 --001a11c160f6086b26054278cb76 Content-Type: text/plain; charset=UTF-8 Hi all, I went ahead and made a quick document describing how all the storage files get laid out, since right now I don't think anything like that exists. It's something we should have described at least a little, as otherwise the only way to know is to read the code. It is good to know what to expect in those folders for diagnosing lots of storage/persistence related issues. The document is here: https://cwiki.apache.org/confluence/display/ASTERIXDB/AsterixDB+On-Disk+File+and+Folder+structure . Suggestions/corrections are more than welcome of course. - Ian --001a11c160f6086b26054278cb76--