Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E764278BC for ; Tue, 27 Dec 2011 04:38:27 +0000 (UTC) Received: (qmail 79915 invoked by uid 500); 27 Dec 2011 04:38:27 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 79887 invoked by uid 500); 27 Dec 2011 04:38:27 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Delivered-To: moderator for dev@hbase.apache.org Received: (qmail 67596 invoked by uid 99); 27 Dec 2011 04:07:30 -0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) From: Jagane Sundar To: "dev@hbase.apache.org" Date: Mon, 26 Dec 2011 23:06:57 -0500 Subject: Writing the WAL to a different filesystem from the HFiles Thread-Topic: Writing the WAL to a different filesystem from the HFiles Thread-Index: AQHMxEz5gYAzfV1opU+O+i8iGVDUZA== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Hello HBaseistas, I have a question: Has anyone here tried to run HBase with the WAL going to= one FileSystem, and the HFiles going to another? My casual perusal of the source code indicates that this is not possible, s= o I am willing to hack a configuration option to do this and try it out. Let me explain my motivation for trying this experiment: I want to run HBas= e on Amazon EC2, with the WAL going to a HDFS on Ephemeral Storage, and HFi= les going to S3. Is this a reasonable thing to attempt? Or am I out of my mind? Thanks in advance, and congratulations on building an outstanding piece of = software. Jagane=