chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From DKN <devapra...@in.ibm.com>
Subject Re: A demo setup on a single linux server
Date Wed, 01 Jun 2011 11:25:11 GMT
Thanks Eric,

The 1st and 2nd problem doesn't appear anymore. I'm using hadoop 0.20.2 and
also exported the following environment variable :
export HADOOP_CLASSPATH=${HADOOP_HOME}/lib/json-simple-1.1.jar:
It didn't appear to be a file permission issue for json-simple-1.1.jar.

The hicc app has been giving some more problems today.

HICC. 1 -> No data available in HBase.

I checked this using hbase shell and doing a scan 'Hadoop' (or other
tables).

I understand that the chukwa collector writes to HBase, simultaneously along
with writing the temp sync files to HDFS (please correct me if I am wrong ..
). The collector logs doesn't indicate anything of such activity with HBase.

I have uncommented the HBaseWriter parameters in chukwa-collector-conf.xml.

Here's the initialization console output when I start the collector. (Note
that I have the correct value for CHUKWA_DATA_DIR .. ).

==================
root@xtest12:/home/dev/chukwa-0.5.0-incubating/bin# WARN: option
chukwa.data.dir may not exist; val = /chukwa
Guesses:
        chukwaRootDir null
        fs.default.name URI
        nullWriter.dataRate Time
WARN: option chukwa.tmp.data.dir may not exist; val = /chukwa/temp
Guesses:
        chukwaRootDir null
        nullWriter.dataRate Time
        chukwaCollector.tee.port Integral
OK chukwaCollector.http.port [Integral] = 8080
OK chukwaCollector.pipeline [ClassName list] =
org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org.apache.hadoop.chukwa.datacollection.writer.hbase.HBaseWriter
OK chukwaCollector.rotateInterval [Time] = 300000
WARN: option hbase.demux.package may not exist; val =
org.apache.hadoop.chukwa.extraction.demux.processor
Guesses:
        fs.default.name URI
        nullWriter.dataRate Time
        CHUKWA_DATA_DIR null
WARN: option hbase.writer.halt.on.schema.mismatch may not exist; val = false
Guesses:
        nullWriter.dataRate Time
        fs.default.name URI
        chukwaCollector.http.threads Integral
WARN: option hbase.writer.verify.schema may not exist; val = false
Guesses:
        nullWriter.dataRate Time
        fs.default.name URI
        httpConnector.asyncAcks Boolean
OK writer.hdfs.filesystem [URI] = hdfs://localhost:9000/
No checker rules for:   chukwaCollector.outputDir
2011-06-01 15:03:08.570::INFO:  Logging to STDERR via
org.mortbay.log.StdErrLog
2011-06-01 15:03:08.616::INFO:  jetty-6.1.11
2011-06-01 15:03:46.083::INFO:  Started SelectChannelConnector@0.0.0.0:8080
started Chukwa http collector on port 8080

==================

HICC. 2-> When I now access the front page (http://localhost:4080/hicc) - [
This somehow appeared to work for me yesterday after some time .. ].
Probably if we address the first issue, this problem may disappear ..

java.util.NoSuchElementException
	at java.util.HashMap$HashIterator.nextEntry(HashMap.java:796)
	at java.util.HashMap$KeyIterator.next(HashMap.java:828)
	at org.apache.jsp.index_jsp._jspService(org.apache.jsp.index_jsp:100)
	at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:93)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:373)
	at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:470)
	at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:364)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)

HICC.3 - hicc application is available only on localhost.

If I try to access hicc on another server, jetty doesn't seem to honor the
request. (for example http://xtest:4080/hicc is not accessible from another
box .. ). Is there a specific setting to be done here in auth.conf ?

Cheers, DKN




--
View this message in context: http://apache-chukwa.679492.n3.nabble.com/A-demo-setup-on-a-single-linux-server-tp3001627p3010248.html
Sent from the Chukwa - Users mailing list archive at Nabble.com.

Mime
View raw message