kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: StorageCleanup error
Date Tue, 04 Jul 2017 01:20:43 GMT
It is easy, you can follow the doc to build a new package:
https://kylin.apache.org/development/howto_package.html


2017-07-03 22:53 GMT+08:00 张绚 <zhx@czkj1010.com>:

> Hi,
>    I has read it ,but 2.0.0 is the last release version on website,
> someone can give me new version package or jar files. Thanks.
>
> 在 2017年7月3日,22:32,ShaoFeng Shi <shaofengshi@apache.org> 写道:
>
> Hi xuan,
>
> Check this:
>
> http://apache-kylin.74782.x6.nabble.com/errors-when-run-
> StorageCleanupJob-td8321.html
>
> 2017-07-03 17:01 GMT+08:00 张绚 <zhx@czkj1010.com>:
>
>> Hi
>>   My test hadoop storage is almost full, so I use StorageCleanupJob to
>> clear the unused data, but got the following error, please help analyze it
>> and give me some suggestions, My kylin has upgraded from 1.6 to 2.0 now.
>> Thanks.
>>
>> 2017-07-03 16:33:36,111 DEBUG [main MetadataManager:384]: Loaded 36
>> SourceTable EXD(s)
>> 2017-07-03 16:33:36,111 DEBUG [main MetadataManager:529]: Reloading
>> DataModel from folder kylin_metadata(key='/model_des
>> c')@kylin_metadata@hbase
>> 2017-07-03 16:33:36,184 ERROR [main MetadataManager:538]: Error to load
>> DataModel at /model_desc/test_model.json
>> java.lang.IllegalStateException: Error to load
>> /model_desc/test_model.json
>>         at org.apache.kylin.metadata.MetadataManager.reloadDataModelDes
>> cAt(MetadataManager.java:558)
>>         at org.apache.kylin.metadata.MetadataManager.reloadAllDataModel
>> (MetadataManager.java:536)
>>         at org.apache.kylin.metadata.MetadataManager.init(MetadataManag
>> er.java:284)
>>         at org.apache.kylin.metadata.MetadataManager.<init>(MetadataMan
>> ager.java:113)
>>         at org.apache.kylin.metadata.MetadataManager.getInstance(Metada
>> taManager.java:83)
>>         at org.apache.kylin.job.dao.ExecutableDao.<init>(ExecutableDao.
>> java:76)
>>         at org.apache.kylin.job.dao.ExecutableDao.getInstance(Executabl
>> eDao.java:57)
>>         at org.apache.kylin.job.execution.ExecutableManager.<init>(
>> ExecutableManager.java:55)
>>         at org.apache.kylin.job.execution.ExecutableManager.getInstance
>> (ExecutableManager.java:64)
>>         at org.apache.kylin.storage.hbase.util.StorageCleanupJob.<clini
>> t>(StorageCleanupJob.java:78)
>> Caused by: java.lang.IllegalArgumentException: Column not found by
>> KYLIN_SALES.USER_ID
>>         at org.apache.kylin.metadata.model.DataModelDesc.findColumn(
>> DataModelDesc.java:240)
>>         at org.apache.kylin.metadata.model.ModelDimensionDesc.init(Mode
>> lDimensionDesc.java:66)
>>         at org.apache.kylin.metadata.model.DataModelDesc.initDimensions
>> AndMetrics(DataModelDesc.java:381)
>>         at org.apache.kylin.metadata.model.DataModelDesc.init(DataModel
>> Desc.java:302)
>>         at org.apache.kylin.metadata.MetadataManager.reloadDataModelDes
>> cAt(MetadataManager.java:554)
>>         ... 9 more
>> 2017-07-03 16:33:36,194 DEBUG [main MetadataManager:543]: Loaded 8
>> DataModel(s)
>> ……
>>
>> 2017-07-03 16:33:43,335 INFO  [main StorageCleanupJob:283]: Checking
>> table OK
>> 2017-07-03 16:33:43,335 INFO  [main StorageCleanupJob:283]: Checking
>> table Time taken: 1.566 seconds
>> 2017-07-03 16:33:43,335 INFO  [main StorageCleanupJob:283]: Checking
>> table OK
>> 2017-07-03 16:33:43,335 INFO  [main StorageCleanupJob:283]: Checking
>> table kylin_intermediate_cube_dim_order_one_6b1de133_a10b_4bb6_86a
>> 7_f249e6d0c418
>> Exception in thread "main" java.lang.RuntimeException: error execute
>> org.apache.kylin.storage.hbase.util.StorageCleanupJob
>>         at org.apache.kylin.common.util.AbstractApplication.execute(Abs
>> tractApplication.java:42)
>>         at org.apache.kylin.storage.hbase.util.StorageCleanupJob.main(
>> StorageCleanupJob.java:362)
>> Caused by: java.lang.NullPointerException
>>         at org.apache.kylin.common.util.ClassUtil.forRenamedClass(Class
>> Util.java:84)
>>         at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.jav
>> a:76)
>>         at org.apache.kylin.job.execution.ExecutableManager.parseTo(
>> ExecutableManager.java:439)
>>         at org.apache.kylin.job.execution.ExecutableManager.getJob(
>> ExecutableManager.java:129)
>>         at org.apache.kylin.storage.hbase.util.StorageCleanupJob.isTabl
>> eInUse(StorageCleanupJob.java:347)
>>         at org.apache.kylin.storage.hbase.util.StorageCleanupJob.cleanU
>> nusedIntermediateHiveTable(StorageCleanupJob.java:302)
>>         at org.apache.kylin.storage.hbase.util.StorageCleanupJob.execut
>> e(StorageCleanupJob.java:153)
>>         at org.apache.kylin.common.util.AbstractApplication.execute(Abs
>> tractApplication.java:37)
>>         ... 1 more
>> 2017-07-03 16:33:43,342 INFO  [Thread-0 ConnectionManager$HConnectionImplementation:2259]:
>> Closing master protocol: MasterService
>> 2017-07-03 16:33:43,368 INFO  [Thread-0 ConnectionManager$HConnectionImplementation:1830]:
>> Closing zookeeper sessionid=0x25cbe7e555d9dc5
>> 2017-07-03 16:33:43,371 INFO  [Thread-0 ZooKeeper:684]: Session:
>> 0x25cbe7e555d9dc5 closed
>> 2017-07-03 16:33:43,371 INFO  [main-EventThread ClientCnxn:512]:
>> EventThread shut down
>>
>> Best regards.
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message