Return-Path: 
 <chukwa-user-return-701-apmail-incubator-chukwa-user-archive=incubator.apache.org@incubator.apache.org>
X-Original-To: apmail-incubator-chukwa-user-archive@www.apache.org
Delivered-To: apmail-incubator-chukwa-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 1250763B4
	for <apmail-incubator-chukwa-user-archive@www.apache.org>;
 Wed,  1 Jun 2011 16:42:53 +0000 (UTC)
Received: (qmail 32786 invoked by uid 500); 1 Jun 2011 16:42:52 -0000
Delivered-To: apmail-incubator-chukwa-user-archive@incubator.apache.org
Received: (qmail 32754 invoked by uid 500); 1 Jun 2011 16:42:52 -0000
Mailing-List: contact chukwa-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:chukwa-user-help@incubator.apache.org>
List-Unsubscribe: <mailto:chukwa-user-unsubscribe@incubator.apache.org>
List-Post: <mailto:chukwa-user@incubator.apache.org>
List-Id: <chukwa-user.incubator.apache.org>
Reply-To: chukwa-user@incubator.apache.org
Delivered-To: mailing list chukwa-user@incubator.apache.org
Received: (qmail 32741 invoked by uid 99); 1 Jun 2011 16:42:52 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 16:42:52 +0000
X-ASF-Spam-Status: No, hits=4.6 required=5.0
	tests=HTML_MESSAGE,NO_RDNS_DOTCOM_HELO,RCVD_IN_DNSWL_NONE,SPF_NEUTRAL,URI_HEX,WEIRD_PORT
X-Spam-Check-By: apache.org
Received-SPF: neutral (nike.apache.org: local policy)
Received: from [69.147.107.20] (HELO mrout1-b.corp.re1.yahoo.com)
 (69.147.107.20)
    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 Jun 2011 16:42:44 +0000
Received: from SP2-EX07CAS04.ds.corp.yahoo.com
 (sp2-ex07cas04.corp.sp2.yahoo.com [98.137.59.5])
	by mrout1-b.corp.re1.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id
 p51Gfpm4096117;
	Wed, 1 Jun 2011 09:41:51 -0700 (PDT)
Received: from SP2-EX07VS05.ds.corp.yahoo.com ([98.137.59.23]) by
 SP2-EX07CAS04.ds.corp.yahoo.com ([98.137.59.5]) with mapi; Wed, 1 Jun 2011
 09:41:50 -0700
From: Eric Yang <eyang@yahoo-inc.com>
To: "chukwa-user@incubator.apache.org" <chukwa-user@incubator.apache.org>,
        "chukwa-user@hadoop.apache.org" <chukwa-user@hadoop.apache.org>
Date: Wed, 1 Jun 2011 09:41:49 -0700
Subject: Re: A demo setup on a single linux server
Thread-Topic: A demo setup on a single linux server
Thread-Index: AcwgWPOrN+pl0WfuSIGoU5HZOAR2cgAIdmqm
Message-ID: <CA0BB9DD.123B2%eyang@yahoo-inc.com>
In-Reply-To: <1306927511309-3010248.post@n3.nabble.com>
Accept-Language: en-US
Content-Language: en
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
acceptlanguage: en-US
Content-Type: multipart/alternative;
	boundary="_000_CA0BB9DD123B2eyangyahooinccom_"
MIME-Version: 1.0
X-Virus-Checked: Checked by ClamAV on apache.org

--_000_CA0BB9DD123B2eyangyahooinccom_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

>From the current configuration, it is setup to write to Hbase only, it does=
 not write to HDFS.  If you want the data to be written to HDFS as well, us=
e this line in chukwa-collector-conf.xml.

  <property>
    <name>chukwaCollector.pipeline</name>
    <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter, =
org.apache.hadoop.chukwa.datacollection.writer.hbase.HBaseWriter, org.apach=
e.hadoop.chukwa.datacollection.writer.SeqFileWriter</value>
  </property>

Make sure that hadoop-site.xml and hbase-site.xml are in the chukwa collect=
or class path.  This can be done by copying hadoop-site.xml and hbase-site.=
xml to CHUKWA_CONF_DIR.

For HICC listening to localhost issue, this is a bug in Chukwa.  Feel free =
to file a jira.  Before compile, modify web/hicc/WEB-INF/jetty.xml and set =
jetty.host ip address to 0.0.0.0.  Without this setup, jetty would choose t=
o bind to first available IP address, it could randomly bind to localhost o=
r eth0 depending on the OS.

Regards,
Eric

On 6/1/11 4:25 AM, "DKN" <devaprasad@in.ibm.com> wrote:

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
root@xtest12:/home/dev/chukwa-0.5.0-incubating/bin# WARN: option
chukwa.data.dir may not exist; val =3D /chukwa
Guesses:
        chukwaRootDir null
        fs.default.name URI
        nullWriter.dataRate Time
WARN: option chukwa.tmp.data.dir may not exist; val =3D /chukwa/temp
Guesses:
        chukwaRootDir null
        nullWriter.dataRate Time
        chukwaCollector.tee.port Integral
OK chukwaCollector.http.port [Integral] =3D 8080
OK chukwaCollector.pipeline [ClassName list] =3D
org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org.apache.h=
adoop.chukwa.datacollection.writer.hbase.HBaseWriter
OK chukwaCollector.rotateInterval [Time] =3D 300000
WARN: option hbase.demux.package may not exist; val =3D
org.apache.hadoop.chukwa.extraction.demux.processor
Guesses:
        fs.default.name URI
        nullWriter.dataRate Time
        CHUKWA_DATA_DIR null
WARN: option hbase.writer.halt.on.schema.mismatch may not exist; val =3D fa=
lse
Guesses:
        nullWriter.dataRate Time
        fs.default.name URI
        chukwaCollector.http.threads Integral
WARN: option hbase.writer.verify.schema may not exist; val =3D false
Guesses:
        nullWriter.dataRate Time
        fs.default.name URI
        httpConnector.asyncAcks Boolean
OK writer.hdfs.filesystem [URI] =3D hdfs://localhost:9000/
No checker rules for:   chukwaCollector.outputDir
2011-06-01 15:03:08.570::INFO:  Logging to STDERR via
org.mortbay.log.StdErrLog
2011-06-01 15:03:08.616::INFO:  jetty-6.1.11
2011-06-01 15:03:46.083::INFO:  Started SelectChannelConnector@0.0.0.0:8080
started Chukwa http collector on port 8080

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

HICC. 2-> When I now access the front page (http://localhost:4080/hicc) - [
This somehow appeared to work for me yesterday after some time .. ].
Probably if we address the first issue, this problem may disappear ..

java.util.NoSuchElementException
        at java.util.HashMap$HashIterator.nextEntry(HashMap.java:796)
        at java.util.HashMap$KeyIterator.next(HashMap.java:828)
        at org.apache.jsp.index_jsp._jspService(org.apache.jsp.index_jsp:10=
0)
        at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:9=
3)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:=
373)
        at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.j=
ava:470)
        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:364=
)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.jav=
a:487)

HICC.3 - hicc application is available only on localhost.

If I try to access hicc on another server, jetty doesn't seem to honor the
request. (for example http://xtest:4080/hicc is not accessible from another
box .. ). Is there a specific setting to be done here in auth.conf ?

Cheers, DKN




--
View this message in context: http://apache-chukwa.679492.n3.nabble.com/A-d=
emo-setup-on-a-single-linux-server-tp3001627p3010248.html
Sent from the Chukwa - Users mailing list archive at Nabble.com.


--_000_CA0BB9DD123B2eyangyahooinccom_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<HTML>
<HEAD>
<TITLE>Re: A demo setup on a single linux server</TITLE>
</HEAD>
<BODY>
<FONT FACE=3D"Calibri, Verdana, Helvetica, Arial"><SPAN STYLE=3D'font-size:=
11pt'>From the current configuration, it is setup to write to Hbase only, i=
t does not write to HDFS. &nbsp;If you want the data to be written to HDFS =
as well, use this line in chukwa-collector-conf.xml.<BR>
<BR>
&nbsp;&nbsp;&lt;property&gt;<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&lt;name&gt;chukwaCollector.pipeline&lt;/name&gt;<B=
R>
&nbsp;&nbsp;&nbsp;&nbsp;&lt;value&gt;org.apache.hadoop.chukwa.datacollectio=
n.writer.SocketTeeWriter, org.apache.hadoop.chukwa.datacollection.writer.hb=
ase.HBaseWriter, org.apache.hadoop.chukwa.datacollection.writer.SeqFileWrit=
er&lt;/value&gt;<BR>
&nbsp;&nbsp;&lt;/property&gt;<BR>
<BR>
Make sure that hadoop-site.xml and hbase-site.xml are in the chukwa collect=
or class path. &nbsp;This can be done by copying hadoop-site.xml and hbase-=
site.xml to CHUKWA_CONF_DIR.<BR>
<BR>
For HICC listening to localhost issue, this is a bug in Chukwa. &nbsp;Feel =
free to file a jira. &nbsp;Before compile, modify web/hicc/WEB-INF/jetty.xm=
l and set jetty.host ip address to 0.0.0.0. &nbsp;Without this setup, jetty=
 would choose to bind to first available IP address, it could randomly bind=
 to localhost or eth0 depending on the OS.<BR>
<BR>
Regards,<BR>
Eric<BR>
<BR>
On 6/1/11 4:25 AM, &quot;DKN&quot; &lt;<a href=3D"devaprasad@in.ibm.com">de=
vaprasad@in.ibm.com</a>&gt; wrote:<BR>
<BR>
</SPAN></FONT><BLOCKQUOTE><FONT FACE=3D"Calibri, Verdana, Helvetica, Arial"=
><SPAN STYLE=3D'font-size:11pt'>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D<BR>
<a href=3D"root@xtest12:/home/dev/chukwa-0.5.0-incubating/bin#">root@xtest1=
2:/home/dev/chukwa-0.5.0-incubating/bin#</a> WARN: option<BR>
chukwa.data.dir may not exist; val =3D /chukwa<BR>
Guesses:<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;chukwaRootDir null<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fs.default.name URI<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;nullWriter.dataRate Time<BR=
>
WARN: option chukwa.tmp.data.dir may not exist; val =3D /chukwa/temp<BR>
Guesses:<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;chukwaRootDir null<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;nullWriter.dataRate Time<BR=
>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;chukwaCollector.tee.port In=
tegral<BR>
OK chukwaCollector.http.port [Integral] =3D 8080<BR>
OK chukwaCollector.pipeline [ClassName list] =3D<BR>
org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org.apache.h=
adoop.chukwa.datacollection.writer.hbase.HBaseWriter<BR>
OK chukwaCollector.rotateInterval [Time] =3D 300000<BR>
WARN: option hbase.demux.package may not exist; val =3D<BR>
org.apache.hadoop.chukwa.extraction.demux.processor<BR>
Guesses:<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fs.default.name URI<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;nullWriter.dataRate Time<BR=
>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;CHUKWA_DATA_DIR null<BR>
WARN: option hbase.writer.halt.on.schema.mismatch may not exist; val =3D fa=
lse<BR>
Guesses:<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;nullWriter.dataRate Time<BR=
>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fs.default.name URI<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;chukwaCollector.http.thread=
s Integral<BR>
WARN: option hbase.writer.verify.schema may not exist; val =3D false<BR>
Guesses:<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;nullWriter.dataRate Time<BR=
>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fs.default.name URI<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;httpConnector.asyncAcks Boo=
lean<BR>
OK writer.hdfs.filesystem [URI] =3D hdfs://localhost:9000/<BR>
No checker rules for: &nbsp;&nbsp;chukwaCollector.outputDir<BR>
2011-06-01 15:03:08.570::INFO: &nbsp;Logging to STDERR via<BR>
org.mortbay.log.StdErrLog<BR>
2011-06-01 15:03:08.616::INFO: &nbsp;jetty-6.1.11<BR>
2011-06-01 15:03:46.083::INFO: &nbsp;Started <a href=3D"SelectChannelConnec=
tor@0.0.0.0:8080">SelectChannelConnector@0.0.0.0:8080</a><BR>
started Chukwa http collector on port 8080<BR>
<BR>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<BR>
<BR>
HICC. 2-&gt; When I now access the front page (<a href=3D"http://localhost:=
4080/hicc">http://localhost:4080/hicc</a>) - [<BR>
This somehow appeared to work for me yesterday after some time .. ].<BR>
Probably if we address the first issue, this problem may disappear ..<BR>
<BR>
java.util.NoSuchElementException<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at java.util.HashMap$HashIt=
erator.nextEntry(HashMap.java:796)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at java.util.HashMap$KeyIte=
rator.next(HashMap.java:828)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.apache.jsp.index_jsp=
._jspService(org.apache.jsp.index_jsp:100)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.apache.jasper.runtim=
e.HttpJspBase.service(HttpJspBase.java:93)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at javax.servlet.http.HttpS=
ervlet.service(HttpServlet.java:820)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at<BR>
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:=
373)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.apache.jasper.servle=
t.JspServlet.serviceJspFile(JspServlet.java:470)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.apache.jasper.servle=
t.JspServlet.service(JspServlet.java:364)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at javax.servlet.http.HttpS=
ervlet.service(HttpServlet.java:820)<BR>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;at org.mortbay.jetty.servle=
t.ServletHolder.handle(ServletHolder.java:487)<BR>
<BR>
HICC.3 - hicc application is available only on localhost.<BR>
<BR>
If I try to access hicc on another server, jetty doesn't seem to honor the<=
BR>
request. (for example <a href=3D"http://xtest:4080/hicc">http://xtest:4080/=
hicc</a> is not accessible from another<BR>
box .. ). Is there a specific setting to be done here in auth.conf ?<BR>
<BR>
Cheers, DKN<BR>
<BR>
<BR>
<BR>
<BR>
--<BR>
View this message in context: <a href=3D"http://apache-chukwa.679492.n3.nab=
ble.com/A-demo-setup-on-a-single-linux-server-tp3001627p3010248.html">http:=
//apache-chukwa.679492.n3.nabble.com/A-demo-setup-on-a-single-linux-server-=
tp3001627p3010248.html</a><BR>
Sent from the Chukwa - Users mailing list archive at Nabble.com.<BR>
<BR>
</SPAN></FONT></BLOCKQUOTE>
</BODY>
</HTML>


--_000_CA0BB9DD123B2eyangyahooinccom_--