kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kanivel (Jira)" <j...@apache.org>
Subject [jira] [Created] (KYLIN-4279) Mapreduce Exception when building cube at step 3
Date Thu, 05 Dec 2019 09:40:00 GMT
Kanivel created KYLIN-4279:
------------------------------

             Summary: Mapreduce Exception when building cube at step 3
                 Key: KYLIN-4279
                 URL: https://issues.apache.org/jira/browse/KYLIN-4279
             Project: Kylin
          Issue Type: Bug
          Components: Tools, Build and Test
    Affects Versions: v2.6.4
            Reporter: Kanivel
         Attachments: Screenshot from 2019-12-05 12-55-22.png, Screenshot from 2019-12-05
12-55-47.png

I have setup hadoop multinode cluster through ambari .ambari running as master node and hive
running in another aws instance.I have installed kylin in master node and configured hive
instance in kylin.properties. I can create model,can create cube.But exception occur when
build cube.Build fails at 3rd step.When I check logs it shows Mapreduce exception.2nd step
also taking more time.I have 3 tables and each have 10 records.sales,customers,products.sales
is a fact table.customers and products are dimesions table..Please look at the attached screenshots.

The below error I got,

org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 13 Job Counters Failed
map tasks=4 Killed reduce tasks=3 Launched map tasks=4 Other local map tasks=3 Data-local
map tasks=1 Total time spent by all maps in occupied slots (ms)=194628 Total time spent by
all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=27804 Total vcore-milliseconds
taken by all map tasks=27804 Total megabyte-milliseconds taken by all map tasks=199299072
Map-Reduce Framework CPU time spent (ms)=0 Physical memory (bytes) snapshot=0 Virtual memory
(bytes) snapshot=0 Job Diagnostics:Task failed task_1575385745059_0009_m_000000 Job failed
as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0 Failure task Diagnostics:
[2019-12-04 07:44:23.184]Exception from container-launch. Container id: container_e03_1575385745059_0009_01_000004
Exit code: 255 [2019-12-04 07:44:23.186]Container exited with a non-zero exit code 255. Error
file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : [2019-12-04
07:44:23.186]Container exited with a non-zero exit code 255. Error file: prelaunch.err. Last
4096 bytes of prelaunch.err : Last 4096 bytes of stderr : at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:173)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:167)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message