kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaofeng SHI (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3116) Speed up load hive metadata
Date Tue, 19 Dec 2017 02:33:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Shaofeng SHI updated KYLIN-3116:
--------------------------------
    Attachment: 屏幕快照 2017-12-19 上午10.31.06.png

> Speed up load hive metadata
> ---------------------------
>
>                 Key: KYLIN-3116
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3116
>             Project: Kylin
>          Issue Type: Bug
>          Components: Metadata
>    Affects Versions: v2.2.0
>         Environment: Centos 7, ambari, HDP 2.6
>            Reporter: vu thanh dat
>            Assignee: Shaofeng SHI
>              Labels: build
>             Fix For: 1.x-HBase1.1.3, v2.2.0
>
>         Attachments: mapreduce.bmp, 屏幕快照 2017-12-19 上午10.31.06.png
>
>
> Hi all,
> im using Kylin to speed up query HDFS.
> Which 2.5 billions records per day. When i'm using Kylin and load hive table, it make
a mapreduce on my server, 2969 map and 1 reduce with only 1 table. My datasource about 10
tables. And it so slow. I attached an image.
> So, can i speed up process "Load hive table" to create model and cubes so quickly?
> Exam use spark (because mapreduce so slow)?
> Best regards, Thanks all



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message