Return-Path: X-Original-To: apmail-incubator-chukwa-user-archive@www.apache.org Delivered-To: apmail-incubator-chukwa-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 096BE9D2A for ; Mon, 12 Dec 2011 20:03:05 +0000 (UTC) Received: (qmail 38283 invoked by uid 500); 12 Dec 2011 20:03:04 -0000 Delivered-To: apmail-incubator-chukwa-user-archive@incubator.apache.org Received: (qmail 38245 invoked by uid 500); 12 Dec 2011 20:03:04 -0000 Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: chukwa-user@incubator.apache.org Delivered-To: mailing list chukwa-user@incubator.apache.org Received: (qmail 38238 invoked by uid 99); 12 Dec 2011 20:03:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Dec 2011 20:03:04 +0000 X-ASF-Spam-Status: No, hits=-0.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of eric818@gmail.com designates 209.85.216.175 as permitted sender) Received: from [209.85.216.175] (HELO mail-qy0-f175.google.com) (209.85.216.175) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 12 Dec 2011 20:02:59 +0000 Received: by qcqw6 with SMTP id w6so3859688qcq.6 for ; Mon, 12 Dec 2011 12:02:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=ZMiBkZ+9B7G1WdUH7Z+nWzUVFnB5I+/0vh0jei4SF44=; b=kSSECLvmUoza7cJ9W29MrnFtDzmtO1MYwB0vRJQ3V3kMHppb5w+woogXI9d2ayano0 wzGt4R+OcMvETE0iOq5HNgL7igoGb2qIzlupK3GDjuV58/A8Nqh1VOYtrgml5axd70fc /miZOvkPA2f/yxhW+NAyMBycEHrdnnWf1nSnQ= MIME-Version: 1.0 Received: by 10.229.233.11 with SMTP id jw11mr2758025qcb.103.1323720158601; Mon, 12 Dec 2011 12:02:38 -0800 (PST) Received: by 10.229.247.196 with HTTP; Mon, 12 Dec 2011 12:02:38 -0800 (PST) In-Reply-To: <001501ccb8a9$61e76440$25b62cc0$@ict.ac.cn> References: <1E7DAA69-9EAD-4A40-AC74-61BAC2D49FAD@gmail.com> <000e01ccb895$2511c060$6f354120$@ict.ac.cn> <001501ccb8a9$61e76440$25b62cc0$@ict.ac.cn> Date: Mon, 12 Dec 2011 12:02:38 -0800 Message-ID: Subject: Re: about hicc installation From: Eric Yang To: chukwa-user@incubator.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable When releasing Chukwa 0.4, we decided that we don't want to continue to support loading data from HDFS to MySQL because that approach does not scale well. It is possible to restore the functionality by copying dbAdmin.sh from Chukwa 0.3 to Chukwa 0.4 to restore mysql functionality. However we do not encourage it. Try to run dbAdmin.sh as a background process. Then run: bin/chukwa dp PostProcessMananger is the process to load data to MySQL. Hope this works for you. regards, Eric On Mon, Dec 12, 2011 at 12:38 AM, zhangliuhang wro= te: > Hi Eric, > =C2=A0 =C2=A0 =C2=A0 =C2=A0Thanks for your help~ > =C2=A0 =C2=A0I have done what you have told to me , but it seems that it = did not work..., I found that there are some other script files in chukwa 0= .3.0/bin/, such as > dbAdmin.sh , dbSetup.sh, dbLoader.sh and mdl.sh, but they are not in chuk= wa 0.4.0. So it confuse me that how and when does chukwa 0.4.0 set up proce= ss to download data from hdfs to > Mysql database...and I don=E2=80=99t know what should I do next.... > > regards, > Liuhang > > -----Original Message----- > From: chukwa-user-return-1044-zhangliuhang=3Dict.ac.cn@incubator.apache.o= rg [mailto:chukwa-user-return-1044-zhangliuhang=3Dict.ac.cn@incubator.apach= e.org] On Behalf Of Eric Yang > Sent: 2011=E5=B9=B412=E6=9C=8812=E6=97=A5 15:45 > To: chukwa-user@incubator.apache.org > Subject: Re: about hicc installation > > Hi Liuhang, > > You will need to have MySQL Connector/J jar file put into CHUKWA_HOME/lib= directory, and configure chukwa-env.sh to have: > > TODO_CHUKWA_JDBC_DRIVER=3Dcom.mysql.jdbc.Driver > TODO_CHUKWA_JDBC_URL_PREFIX=3Djdbc:mysql:// > > both properties configured. =C2=A0In addition, also specify jdbc.conf to = have cluster name maps to mysql url. =C2=A0For example, > > demo=3Djdbc:mysql://localhost:3306/test?user=3Droot > > Detail instruction is also on Chukwa 0.4 document: > > http://incubator.apache.org/chukwa/docs/r0.4.0/admin.html#Set+Up+the+Data= base > > regards, > Eric > On Sun, Dec 11, 2011 at 10:13 PM, zhangliuhang w= rote: >> Hi, Eric, >> =C2=A0 =C2=A0 =C2=A0 =C2=A0Thanks for your help, I have set up hicc succ= essfully, but I >> encounter another problem that my database seemed to be nothing, The hic= c show me "no data available", I don't know how to download data from the h= dfs to mysql, could you help me ? >> >> Liuhang Zhang >> >> -----Original Message----- >> From: >> chukwa-user-return-1042-zhangliuhang=3Dict.ac.cn@incubator.apache.org >> [mailto:chukwa-user-return-1042-zhangliuhang=3Dict.ac.cn@incubator.apach >> e.org] On Behalf Of Eric Yang >> Sent: 2011=E5=B9=B412=E6=9C=8812=E6=97=A5 13:10 >> To: chukwa-user@incubator.apache.org >> Subject: Re: about hicc installation >> >> For HICC, just run it as ./bin/chukwa hicc. =C2=A0There is no need to de= ploy it to Tomcat. =C2=A0Remove it from apache-tomcat webapp directory and = stop apache tomcat. =C2=A0Make sure HADOOP_CONF_DIR is in class path by add= ing to chukwa-env.sh like this: >> >> export CLASSPATH=3D${CLASSPATH}:${HADOOP_CONF_DIR} >> >> regards, >> Eric >> >> On Sun, Dec 11, 2011 at 5:18 PM, wang zhihao wrot= e: >>> HI Eric >>> I just try to install hicc, but I have encounter some troubles. Follows= are my operations: >>> >>> (1) copy hicc.war to /opt/apache-tomcat-6.0.18/webapps/ >>> (2) /chukwa/bin/hicc.sh start >>> >>> but it didn't work,here is the error: >>> java.lang.NullPointerException >>> =C2=A0 =C2=A0 =C2=A0 =C2=A0at >>> org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(ViewResou >>> r >>> ce.java:55) >>> >>> Finally I found that it could not load the hadoop configration from >>> the some files like core-site.xml, could you tell me what should I do t= o solve this problem? Or could you show me your install flow about hicc? Th= anks. >>> >>> Regards >>> Zhang liuhang >> >> > >