kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wang rupeng <wangrup...@live.cn>
Subject Re: kylin2.6.4流式构建不能与hdp3.1.4.0使用(issue3970)
Date Thu, 24 Oct 2019 07:17:47 GMT
It seems like your map reduce job got a problem, please check mr job log from your yarn.

在 2019/10/24 14:24,“田家铮”<tianjiazheng@tuzhanai.com> 写入:

    The error reported in the log is the same as the error reported in the issue, and the
scheme provided by the issue has been tried, but it still cannot be solved, and the reason
is unknown.
    This is the logs , please take a look ,thanks 
    
    
    ————————————————————————————————————————————————————————————————
    2019-10-09 23:58:44,395 ERROR [pool-11-thread-1] threadpool.DefaultScheduler:116 : ExecuteException
job:dab5ba1f-e1ed-c8fa-409c-29f71715e8e0
    org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job job_1570617080701_0005Job
Diagnostics:Task failed task_1570617080701_0005_m_000000
    Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
    Failure task Diagnostics:
    Error: org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
    
    
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:182)
            at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.engine.mr.exception.MapReduceException:
no counters for job job_1570617080701_0005Job Diagnostics:Task failed task_1570617080701_0005_m_000000
    Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
    Failure task Diagnostics:
    Error: org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
    
    
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:182)
            at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
            ... 4 more
    Caused by: org.apache.kylin.engine.mr.exception.MapReduceException: no counters for job
job_1570617080701_0005Job Diagnostics:Task failed task_1570617080701_0005_m_000000
    Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
    Failure task Diagnostics:
    Error: org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
    
    
            at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173)
            at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
            ... 6 more
    2019-10-09 23:58:44,396 INFO  [FetcherRunner 1609136206-49] threadpool.DefaultFetcherRunner:85
: Job Fetcher: 0 should running, 0 actual running, 0 stopped, 0 ready, 0 already succeed,
1 error, 0 discarded, 0 others
    2019-10-09 23:58:44,400 DEBUG [http-nio-7070-exec-7] cachesync.Broadcaster:246 : Broadcasting
UPDATE, execute_output, dab5ba1f-e1ed-c8fa-409c-29f71715e8e0
    2019-10-09 23:58:44,401 DEBUG [http-nio-7070-exec-7] cachesync.Broadcaster:280 : Done
broadcasting UPDATE, execute_output, dab5ba1f-e1ed-c8fa-409c-29f71715e8e0
    2019-10-09 23:59:12,827 INFO  [FetcherRunner 1609136206-49] threadpool.DefaultFetcherRunner:85
: Job Fetcher: 0 should running, 0 actual running, 0 stopped, 0 ready, 0 already succeed,
1 error, 0 discarded, 0 others
    
    
    
    ————————————————————————————————————————————————————————————————
     
    
    
    ------------------ Original ------------------
    From:  "Xiaoxiang Yu"<xiaoxiang.yu@kyligence.io>;
    Date:  Thu, Oct 24, 2019 01:32 PM
    To:  "dev@kylin.apache.org"<dev@kylin.apache.org>; "tianjiazheng@tuzhanai.com"<tianjiazheng@tuzhanai.com>;

    
    Subject:  Re: kylin2.6.4流式构建不能与hdp3.1.4.0使用(issue3970)
    
     
    
    Hi Sir,
       I cannot see your screenshot, could you please paste the stack trace (in kylin.log)
or provided more description to us?
      And have you ever try use the workaround which was provided in KYLIN-3970 to fix your
problem?
    ----------------
    Best wishes,
    Xiaoxiang Yu
    
    
    发件人: 田家铮 <tianjiazheng@tuzhanai.com>
    答复: "dev@kylin.apache.org" <dev@kylin.apache.org>
    日期: 2019年10月24日 星期四 11:44
    收件人: dev <dev@kylin.apache.org>
    主题: kylin2.6.4流式构建不能与hdp3.1.4.0使用(issue3970)
    
    环境配置:
         kylin-2.6.4
         HDP-3.1.4。0
    
    issue:
         3970
         https://issues.apache.org/jira/browse/KYLIN-3970?jql=text%20~%20%22partition.assignment.strategy%22<https://issues.apache.org/jira/browse/KYLIN-3970?jql=text%20%7E%20%22partition.assignment.strategy%22>
    
    
    问题:
        流式构建读取kafka数据时,无法构建,但是hive构建没问题
    
    [cid:E5BB65D6@3C8BF016.500DB15D]
    [cid:1F6BECD4@A04E8373.500DB15D]


Mime
View raw message