incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <eric...@gmail.com>
Subject Re: how to let hicc know fs.default.name
Date Mon, 12 Dec 2011 05:06:02 GMT
For writer.hdfs.filesystem and fs.default.name, can you make sure that
they are the same?  There maybe hidden problem when one is referred by
hostname and one is referred by ip address.

regards,
Eric

2011/12/11 wang zhihao <accept.acm@gmail.com>:
> HI Eric
> I'm sure I add the chukwa-collector-conf.xml 's directory to classpath
> and writer.hdfs.filesystem has right value.
>
>
> This is my classpath:
> [root@gd103 apache-tomcat-6.0.35]# echo $CLASSPATH
> /home/chukwa/chukwa-0.4.0/conf:/home/hadoop/hadoop-0.20.2/conf:/usr/java/jdk1.6.0_16/lib:/usr/ant/ant-1.7.0/lib:/home/hadoop/hadoop-0.20.2/hadoop-0.20.2-core.jar:/home/hadoop/hadoop-0.20.2/lib/*:/home/hadoop/hadoop-0.20.2/lib/commons-logging-1.0.4.jar:/usr/ant/ant-1.7.0/junit-3.8.1.jar:/home/hadoop/hadoop-0.20.2/ivy/ivy-2.0.0-rc2.jar:/home/hadoop/hadoop-0.20.2/lib/commons-logging-api-1.0.4.jar:/home/hadoop/hadoop-0.20.2/lib/log4j-1.2.15.jar:/home/hadoop/hadoop-0.20.2/lib/hadoop-lzo-0.4.8.jar:/home/chukwa/chukwa-0.4.0/bin/../chukwa-core-0.4.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/asm-3.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-beanutils-1.8.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-cli-2.0-SNAPSHOT.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-codec-1.3.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-collections-3.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-fileupload-1.2.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-httpclient-3.0.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-io-1.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-lang-2.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-logging-1.1.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-logging-api-1.0.4.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/commons-net-1.4.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/core-3.1.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/ezmorph-1.0.6.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/html-filter-1.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jchronic-0.2.3.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jersey-bundle-1.1.0-ea.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jetty-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jetty-util-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/json.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/json-lib-2.2.3-jdk15.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsp-2.1-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsp-api-2.1-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/jsr311-api-1.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/junit-3.8.1.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/log4j-1.2.13.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/mysql-connector-java-5.1.6.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/NagiosAppender-1.5.0.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/prefuse.jar:/home/chukwa/chukwa-0.4.0/bin/../lib/servlet-api-2.5-6.1.11.jar:/home/chukwa/chukwa-0.4.0/bin/../webapps/hicc.war:/home/hadoop/hadoop-0.20.2/hadoop-0.20.2-core.jar:/home/chukwa/chukwa-0.4.0/bin/../hicc.war
>
> This is my chukwa-collector-conf.xml:
>
> <configuration>
>
>   <property>
>     <name>chukwaCollector.writerClass</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter</value>
>   </property>
>
>   <property>
>     <name>chukwaCollector.pipeline</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.SocketTeeWriter,org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter</value>
>   </property>
>
> <!-- LocalWriter parameters
>   <property>
>     <name>chukwaCollector.localOutputDir</name>
>     <value>/tmp/chukwa/dataSink/</value>
>     <description>Chukwa local data sink directory, see
> LocalWriter.java</description>
>   </property>
>
>   <property>
>     <name>chukwaCollector.writerClass</name>
>
> <value>org.apache.hadoop.chukwa.datacollection.writer.localfs.LocalWriter</value>
>     <description>Local chukwa writer, see LocalWriter.java</description>
>   </property>
> -->
>
>
>
>   <property>
>     <name>writer.hdfs.filesystem</name>
>     <value>hdfs://10.10.104.102:9955/</value>
>     <description>HDFS to dump to</description>
>   </property>
>
>   <property>
>     <name>chukwaCollector.outputDir</name>
>     <value>/home/chukwa/chukwa-0.4.0/logs/</value>
>     <description>Chukwa data sink directory</description>
>   </property>
>
>   <property>
>     <name>chukwaCollector.rotateInterval</name>
>     <value>300000</value>
>     <description>Chukwa rotate interval (ms)</description>
>   </property>
>
>   <property>
>     <name>chukwaCollector.http.port</name>
>     <value>5000</value>
>     <description>The HTTP port number the collector will listen
> on</description>
>   </property>
>
> </configuration>
>
> And the following is my core-site.xml:
>
> <configuration>
>
> <property>
> <name>hadoop.tmp.dir</name>
> <value>/root/tmp</value>
> <description>A base for other temporary directories.</description>
> </property>
> <property>
> <name>fs.default.name</name>
> <value>hdfs://master:9955</value>
> </property>
> <property>
> <name>hadoop.native.lib</name>
>   <value>true</value>
> </property>
> </configuration>
>
> Thank you for your reviewing.
> Best Regards
> Wang Zhihao
>
>
> 在 2011-12-12,上午3:27, Eric Yang 写道:
>
> Hi Zhihao,
>
> Make sure the chukwa-collector-conf.xml has value defined for
> writer.hdfs.filesystem, and chukwa-collector-conf.xml is on the class
> path of hicc server deployment.
>
> regards,
> Eric
>
> 2011/12/11 zhihao wang <accept.acm@gmail.com>:
>
>
> Greetings
>
>
> I got a problem when deploying the hicc.war in chukwa-0.4.0, It can not find
>
> the value of fs.default.name.
>
> The default value "file:///" was returned.
>
>
> I set fs.default.name as "hdfs://10.10.104.102:9955" in core-site.xml, which
>
> directory is /home/hadoop/conf.
>
> Then I add this directory to the classpath by use the following command in
>
> bash.
>
>
>     export CLASSPATH=CLASSPATH:/home/hadoop/conf
>
>
> But it still can not find the value of fs.default.name.
>
>
> Best regards
>
> Wang Zhihao
>
>
> --
>
> 致敬
>
> 王之昊
>
>
>

Mime
View raw message