incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Yang <ey...@yahoo-inc.com>
Subject Re: chukwa configuration
Date Fri, 03 Sep 2010 16:54:29 GMT
Hi 良人,

The first error indicates there is a problem with database table creation.
Check if mysql contains this table:

create table if not exists mapreduce_fsm_template (
    job_id VARCHAR(80),
    unique_id VARCHAR(80),
    friendly_id VARCHAR(80),
    state_name VARCHAR(80),
    hostname VARCHAR(80),
    other_host VARCHAR(80),
    start_time timestamp default 0,
    finish_time timestamp default 0,
    start_time_millis bigint default 0,
    finish_time_millis bigint default 0,
    status varchar(10) default 0,
    file_bytes_read bigint default 0,
    file_bytes_written bigint default 0,
    combine_input_records bigint default 0,
    combine_output_records bigint default 0,
    input_records bigint default 0,
    output_records bigint default 0,
    input_bytes bigint default 0,
    output_bytes bigint default 0,
    input_groups bigint default 0,
    spilled_records bigint default 0,
    primary key(unique_id),
    index(start_time, finish_time, job_id)
) ENGINE=InnoDB;

This may be caused by lacking of dbAdmin.sh running.  I removed dbAdmin.sh
in Chukwa 0.4, but if you want to use mysql with Chukwa, then you need to
copy dbAdmin.sh from Chukwa 0.3 and put in chukwa-0.4.0/bin directory.

The second problem is that view in hdfs://host/chukwa/hicc/view may be
corrupted, or not populated correctly.  Please move existing /chukwa/hicc to
another directory, and restart hicc to let hicc populate the directory
again.  Please make sure hicc has read/write access in /chukwa.

Regards,
Eric
On 9/3/10 8:26 AM, "良人" <zhu121972@163.com> wrote:

> hi:
>   i configure the chuwa one month, but some quesiton disturbed me,the hicc
> stil can not work and the log can go into mysql database.
> could you give me some adivce ,thank you .
> the postprocess error information:
> 010-09-02 08:02:51,652 ERROR pool-2-thread-1 MetricDataLoader -
> java.sql.BatchUpdateException: Table 'chukwa.mapreduce_fsm_2122_week' doesn't
> exist
> java.sql.BatchUpdateException: Table 'chukwa.mapreduce_fsm_2122_week' doesn't
> exist
>  at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
>  at 
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java
> :494)
>  at 
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.jav
> a:571)
>  at 
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.jav
> a:50)
>  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>  at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> :886)
>  at 
> 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908>
)
> .2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.contextname does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.queuesize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.chukwa_timestamp
> does not contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.fullqueue does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.hostname does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.period does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.recordname does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.addedchunk does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.datasize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.removedchunk does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.contextname does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.queuesize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.chukwa_timestamp
> does not contain valid MDL structure.
>  
>  
>  
> the hicc log information following:
> 2010-09-03 07:29:07,122 ERROR btpool0-3 ViewStore - org.json.JSONException: A
> JSONObject text must begin with '{' at character 1 of [{"description":"Default
> view","owner":"","permission":{"all":{"modify":1,"read":1}},"key":"default"}]
>  at org.json.JSONTokener.syntaxError(JSONTokener.java:448)
>  at org.json.JSONObject.<init>(JSONObject.java:174)
>  at org.json.JSONObject.<init>(JSONObject.java:242)
>  at org.apache.hadoop.chukwa.datastore.ViewStore.list(ViewStore.java:217)
>  at 
> org.apache.hadoop.chukwa.rest.resource.ViewResource.getUserViewList(ViewResour
> ce.java:159)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.j
> ava:25)
>  at java.lang.reflect.Method.invoke(Method.java:597)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatc
> hProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java
> :156)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.
> dispatch(ResourceJavaMethodDispatcher.java:67)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java
> :166)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRul
> e.java:114)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRul
> e.java:74)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRul
> e.java:114)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResour
> ceClassesRule.java:66)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebAp
> plicationImpl.java:658)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApp
> licationImpl.java:616)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApp
> licationImpl.java:607
> 
> 
> 网易邮箱,没有垃圾邮件的邮箱。 <http://mail.163.com/?from=fe1> 

Mime
View raw message