Return-Path: Delivered-To: apmail-hadoop-chukwa-user-archive@minotaur.apache.org Received: (qmail 18247 invoked from network); 2 Dec 2009 23:31:23 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 2 Dec 2009 23:31:23 -0000 Received: (qmail 24601 invoked by uid 500); 2 Dec 2009 23:31:23 -0000 Delivered-To: apmail-hadoop-chukwa-user-archive@hadoop.apache.org Received: (qmail 24561 invoked by uid 500); 2 Dec 2009 23:31:22 -0000 Mailing-List: contact chukwa-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-user@hadoop.apache.org Delivered-To: mailing list chukwa-user@hadoop.apache.org Received: (qmail 24552 invoked by uid 99); 2 Dec 2009 23:31:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Dec 2009 23:31:22 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of mjlai09@gmail.com designates 209.85.211.193 as permitted sender) Received: from [209.85.211.193] (HELO mail-yw0-f193.google.com) (209.85.211.193) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Dec 2009 23:31:13 +0000 Received: by ywh31 with SMTP id 31so745784ywh.30 for ; Wed, 02 Dec 2009 15:30:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=vslj5YpJSuPTN5yqP2wQ+U9DUPYq/oLsHl/83JmaUSs=; b=eD9KnVAt+qt6azg7FWt4DZzIT9TWZXY7VbqYMHPQ/GTfY9bHHXzf86v17KsmuiqhYm nV5r8n9obG8Cwe/clz6Dp+PdfNCXheVdo47Cqr85TF08aZIfNcQAkvm8C7F0Leg+Hze5 JZ0J4ShM9yAta+U44LeC0kbyA5dpaO4s3bDNg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; b=IcS8HmKdrFsN8lHHfU34RYPwkQbKn0mQmnorQa8yy+m7USFTZOP9RMlQI6WbNAncXS aXhI1AfdEWd1oSvm2myT2eyonzBp/Xkwoyu4W3FnROUSdMqdAxwvRR2TYWOqcymYMwXd iKOewayTxZiV5VLsCEaLBQAM80ak8brbwEcEA= Received: by 10.150.213.7 with SMTP id l7mr1459096ybg.220.1259796652161; Wed, 02 Dec 2009 15:30:52 -0800 (PST) Received: from ?10.2.42.205? ([216.99.128.98]) by mx.google.com with ESMTPS id 5sm603540ywd.38.2009.12.02.15.30.50 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 02 Dec 2009 15:30:51 -0800 (PST) Message-ID: <4B16F8A9.8070409@googlemail.com> Date: Wed, 02 Dec 2009 15:30:49 -0800 From: MJ Lai User-Agent: Thunderbird 2.0.0.23 (Windows/20090812) MIME-Version: 1.0 To: chukwa-user@hadoop.apache.org Subject: What's Chukwa for? References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi. It is another ``what for'' question. I went thru the chukwa web site and am still kind of confused by what is software really for. Can I say the major purpose is to provide 1) a generic distributed log processing system, or 2) this log system is only for Hadoop cluster? In case of 1), why do we want to make it tightly bound to Hadoop? Assume we have a 100-machine cluster (no hadoop), if I deploy Chukwa to process the cluster logs, I still need to create another hadoop cluster to make it work? I think some practical use cases could reduce the confusions of this this project. Thanks. MJ