incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wang zhihao <accept....@gmail.com>
Subject Re: how to let hicc know fs.default.name
Date Mon, 12 Dec 2011 01:15:03 GMT
HI Eric
I'm sure I add the chukwa-collector-conf.xml 's directory to classpath and writer.hdfs.filesystem
has right value.


This is my classpath:
[root@gd103 apache-tomcat-6.0.35]# echo $CLASSPATH 
/home/chukwa/chukwa-0.4.0/conf:/home/hadoop/hadoop-0.20.2/conf:/usr/java/jdk1.6.0_16/lib:/usr/ant/ant-1.7.0/lib:/home/hadoop/hadoop-0.20.2/hadoop-0.20.2-core.jar:/home/hadoop/hadoop-0.20.2/lib/*:/home/hadoop/hadoop-0.20.2/lib/commons-logging-1.0.4.jar:/usr/ant/ant-1.7.0/junit-3.8.1.jar:/home/hadoop/hadoop-0.20.2/ivy/ivy-2.0.0-rc2.jar:/home/hadoop/hadoop-0.20.2/lib/commons-logging-api-1.0.4.jar:/home/hadoop/hadoop-0.20.2/lib/log4j-1.2.15.jar:/home/hadoop/hadoop-0.20.2/lib/hadoop-lzo-0.4.8.jar:/home/chukwa/chukwa-0.4.0/bin/../chukwa-core-0.4.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/asm-3.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-beanutils-1.8.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-cli-2.0-SNAPSHOT.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-codec-1.3.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-collections-3.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-fileupload-1.2.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-httpclient-3.0.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-io-1.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-lang-2.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-logging-1.1.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-logging-api-1.0.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-net-1.4.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/core-3.1.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/ezmorph-1.0.6.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/html-filter-1.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jchronic-0.2.3.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jersey-bundle-1.1.0-ea.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jetty-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jetty-util-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/json.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/json-lib-2.2.3-jdk15.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsp-2.1-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsp-api-2.1-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsr311-api-1.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/junit-3.8.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/log4j-1.2.13.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/mysql-connector-java-5.1.6.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/NagiosAppender-1.5.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/prefuse.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/servlet-api-2.5-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../webapps/hicc.war:/home/hadoop/hadoop-0.20.2/hadoop-0.20.2-core.jar:/home/chukwa/chukwa-0.4.0/bin/../hicc.war

This is my chukwa-collector-conf.xml:

<configuration>

  <property>
    <name>chukwaCollector.writerClass</name>
    <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</value>
  </property>

  <property>
    <name>chukwaCollector.pipeline</name>
    <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter</value>
  </property>

<!-- LocalWriter parameters
  <property>
    <name>chukwaCollector.localOutputDir</name>
    <value>/tmp/chukwa/dataSink/</value>
    <description>Chukwa local data sink directory, see LocalWriter.java</description>
  </property>

  <property>
    <name>chukwaCollector.writerClass</name>
    <value>org.apache.hadoop.chukwa.datacollection.writer.localfs.LocalWriter</value>
    <description>Local chukwa writer, see LocalWriter.java</description>
  </property>
-->



  <property>
    <name>writer.hdfs.filesystem</name>
    <value>hdfs://10.10.104.102:9955/</value>
    <description>HDFS to dump to</description>
  </property>
  
  <property>
    <name>chukwaCollector.outputDir</name>
    <value>/home/chukwa/chukwa-0.4.0/logs/</value>
    <description>Chukwa data sink directory</description>
  </property>

  <property>
    <name>chukwaCollector.rotateInterval</name>
    <value>300000</value>
    <description>Chukwa rotate interval (ms)</description>
  </property>

  <property>
    <name>chukwaCollector.http.port</name>
    <value>5000</value>
    <description>The HTTP port number the collector will listen on</description>
  </property>

</configuration>

And the following is my core-site.xml:

<configuration>

	<property>
		<name>hadoop.tmp.dir</name>
		<value>/root/tmp</value>
		<description>A base for other temporary directories.</description>
	</property>
	<property>
		<name>fs.default.name</name>
		<value>hdfs://master:9955</value>
	</property>
	<property>
	 	<name>hadoop.native.lib</name>
  		<value>true</value>
	</property> 
	
</configuration>

Thank you for your reviewing.
Best Regards
Wang Zhihao


在 2011-12-12,上午3:27, Eric Yang 写道:

> Hi Zhihao,
> 
> Make sure the chukwa-collector-conf.xml has value defined for
> writer.hdfs.filesystem, and chukwa-collector-conf.xml is on the class
> path of hicc server deployment.
> 
> regards,
> Eric
> 
> 2011/12/11 zhihao wang <accept.acm@gmail.com>:
>> 
>> Greetings
>> 
>> I got a problem when deploying the hicc.war in chukwa-0.4.0, It can not find
>> the value of fs.default.name.
>> The default value "file:///" was returned.
>> 
>> I set fs.default.name as "hdfs://10.10.104.102:9955" in core-site.xml, which
>> directory is /home/hadoop/conf.
>> Then I add this directory to the classpath by use the following command in
>> bash.
>> 
>>     export CLASSPATH=CLASSPATH:/home/hadoop/conf
>> 
>> But it still can not find the value of fs.default.name.
>> 
>> Best regards
>> Wang Zhihao
>> 
>> --
>> 致敬
>> 王之昊
>> 


Mime
View raw message