kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: Persistent error after Kafka streaming cube source stopped
Date Mon, 16 Oct 2017 13:18:06 GMT
>From this message, it is probably caused by unstable Hadoop env:

org.apache.kylin.job.exception.hdfs.BlockMissingException: Could not obtain
block: BP-699932432.....

Need full log to detect the root cause.

2017-10-16 20:13 GMT+08:00 Billy Liu <billyliu@apache.org>:

> Hi Roberto,
>
> Could you update more logs. It should has more logs from the context.
>
> 2017-10-16 17:19 GMT+08:00 Roberto Tardío <roberto.tardio@stratebi.com>:
>
>> Hi,
>>
>> I'm doing a PoC with to build a cube with Kylin using a Streaming Data
>> with Kafka. Kafka connection and cube creation works correctly. I have
>> tested using the Kafka test generator included with Kylin and I scheduled
>> the process with Crontab for its execution every 10 minutes, during a
>> period of 24 hours. However when I stopped Kafka generator and Crontab
>> schedule, I got errors in Kylin:
>>
>>    - Monitor show error when it tries to load jobs. This affects not
>>    only to Kafka test project, but also to rest other batch projects.
>>       - Kyling log show this:
>>       - ERROR [http-bio-7070-exec-4] controller.BasicController:57 :
>>          org.apache.kylin.rest.exception.InternalErrorException:
>>          java.lang.RuntimeException: org.apache.kylin.job.exception.PersistentException:
>>          com.fasterxml.jackson.databind.JsonMappingException: No content
>>          to map due to end-of-input
>>           at [Source: java.io.DataInputStream@189348ee; line: 1, column:
>>          1]
>>          - I cannot purge or drop this Kafka test streaming cube.
>>       - Kyli UI shows the following error:
>>          - Failed to delete cube. Caused by:
>>          org.apache.kylin.job.exception.hdfs.BlockMissingException:
>>          Could not obtain block: BP-699932432.....
>>
>> I have tried and received the same error with Kylin 1.6 and Kylin 2.1.
>> Now I Kylin is still running, but I have to solve this errors to use it in
>> a normal way (e.g. building new cubes)
>>
>> ¿Anyone can help me?
>>
>> Thanks in advance,
>>
>> *Roberto Tardío Olmos*
>> *Senior Big Data & Business Intelligence Consultant*
>> Avenida de Brasil, 17
>> <https://maps.google.com/?q=Avenida+de+Brasil,+17&entry=gmail&source=g>,
>> Planta 16.28020 Madrid
>> Fijo: 91.788.34.10
>>
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message