Return-Path: Delivered-To: apmail-hbase-user-archive@www.apache.org Received: (qmail 73098 invoked from network); 27 Oct 2010 05:28:08 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 27 Oct 2010 05:28:08 -0000 Received: (qmail 24759 invoked by uid 500); 27 Oct 2010 05:28:07 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 24494 invoked by uid 500); 27 Oct 2010 05:28:04 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 24485 invoked by uid 99); 27 Oct 2010 05:28:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Oct 2010 05:28:03 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of hbasedev@aol.com designates 205.188.105.146 as permitted sender) Received: from [205.188.105.146] (HELO imr-da04.mx.aol.com) (205.188.105.146) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Oct 2010 05:27:56 +0000 Received: from mtaomg-ma04.r1000.mx.aol.com (mtaomg-ma04.r1000.mx.aol.com [172.29.41.11]) by imr-da04.mx.aol.com (8.14.1/8.14.1) with ESMTP id o9R5RP0x016358 for ; Wed, 27 Oct 2010 01:27:25 -0400 Received: from core-mbe001b.r1000.mail.aol.com (core-mbe001.r1000.mail.aol.com [172.29.31.144]) by mtaomg-ma04.r1000.mx.aol.com (OMAG/Core Interface) with ESMTP id 245F7E000081 for ; Wed, 27 Oct 2010 01:27:25 -0400 (EDT) References: <8CD436F25226594-1250-630B@webmail-m005.sysops.aol.com><8CD437063DD47BA-1250-653E@webmail-m005.sysops.aol.com> <5A76F6CE309AD049AAF9A039A39242820F0B7D59@sc-mbx04.TheFacebook.com> To: user@hbase.apache.org Subject: Re: Contributing to hbase but test with less hardware X-AOL-IP: 99.229.155.62 In-Reply-To: X-MB-Message-Source: WebUI MIME-Version: 1.0 From: hbasedev@aol.com X-MB-Message-Type: User Content-Type: multipart/alternative; boundary="--------MB_8CD43AEC5A85AC2_1FA4_B5C13_Webmail-m108.sysops.aol.com" X-Mailer: AOL Webmail 32823-STANDARD Received: from 99.229.155.62 by Webmail-m108.sysops.aol.com (64.12.232.213) with HTTP (WebMailUI); Wed, 27 Oct 2010 01:27:24 -0400 Message-Id: <8CD43AEC592EE62-1FA4-4FD5D@Webmail-m108.sysops.aol.com> X-Originating-IP: [99.229.155.62] Date: Wed, 27 Oct 2010 01:27:25 -0400 (EDT) x-aol-global-disposition: G X-AOL-SCOLL-SCORE: 0:2:488790560:93952408 X-AOL-SCOLL-URL_COUNT: 0 x-aol-sid: 3039ac1d290b4cc7b83d1ad2 X-Virus-Checked: Checked by ClamAV on apache.org ----------MB_8CD43AEC5A85AC2_1FA4_B5C13_Webmail-m108.sysops.aol.com Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="us-ascii" Thanks all for your help. If Todd can do most of his HBase work on a lapto= p, then I should be able to, too :) Per Andy and Jonathan, I will take a lo= ok at Andy's EC2 scripts as well. =20 Mike =20 ---- Original Message ---- From: Todd Lipcon To: user Sent: Tue, Oct 26, 2010 10:05 pm Subject: Re: Contributing to hbase but test with less hardware +1 to unit tests and pseudo-distributed testing. I do the majority of my work on a laptop as well. I only move to my 5 or 6 node test clusters when working on failure testing, load testing, or benchmarks. -Todd On Tue, Oct 26, 2010 at 3:11 PM, Jonathan Gray wrote: > One option is to use EC2 to spin up a cluster for a short period of time > and test on it, but that brings along its own set of complications. > > What kind of things are you hoping to contribute? I would say the best w= ay > to do things if you don't have large clusters to test on is write lots of > good unit tests. > > A vast majority of the testing I do is either through unit tests or small= er > (5 or so) node clusters. After things work there, then there's the > long-running large cluster tests, but things go through lots of other > testing prior to that. > > If you have specific things you'd like to work on but feel that it requir= es > a lot of large cluster load testing, then try to convince someone from SU= , > Cloudera, or FB to help you test it :) Easiest way to do that is with co= ol > features and good unit testing. > > JG > > > -----Original Message----- > > From: hbasedev@aol.com [mailto:hbasedev@aol.com] > > Sent: Tuesday, October 26, 2010 3:01 PM > > To: user@hbase.apache.org > > Subject: Contributing to hbase but test with less hardware > > > > > > Dear HBase devs, > > > > > > I am reading the HBase sources and have also read the > > http://wiki.apache.org/hadoop/Hbase/HowToContribute wiki page including > > the jira "noob" label suggestion. If I do not have 4 or 5 machines at > > home with sufficient RAM to test changes on a meaningful HBase cluster, > > what are my other alternatives? Apart from companies with large > > deployments (su, cloudera, y!) and where devs can remotely test their > > changes, is there a free/cheap cluster for the less fortunate others > > who own laptops with 2GB RAM? Thanks for your help. > > > > Mike > > > > > > > > > > > --=20 Todd Lipcon Software Engineer, Cloudera =20 ----------MB_8CD43AEC5A85AC2_1FA4_B5C13_Webmail-m108.sysops.aol.com--