kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: Error - Step Name: Load HFile to HBase Table
Date Mon, 13 Nov 2017 14:44:59 GMT
The bulkload step will perform a "chmod 777" operation for the hfiles,
which might not suitable for your case.

You can disable this operation in
the org.apache.kylin.storage.hbase.steps.BulkLoadJob, and then make a new
binary build to move ahead.

2017-11-13 21:35 GMT+08:00 杨浩 <yanghaogn@gmail.com>:

> Can you change the log level of kylin to DEBUG to see more details
>
> 2017-11-13 18:49 GMT+08:00 <Vikash.Tandon@barclaycard.co.uk>:
>
>> Hi,
>>
>>
>>
>> Thanks for your comments. We setup encryption zone correctly and can see
>> it’s progressed.
>>
>> However it still fails on same Step 10 with different error message
>> related to File permission.
>>
>>
>>
>> java.io.IOException: Failed to change the file permissions:
>> hdfs://bpaiddev/kylin/kylin_metadata/kylin-358c3b55-123e-47c
>> 5-bce6-57111eb20afa/New_cube_20160131/hfile
>>
>>
>>
>> Please can you suggest how we can fix this error related to file
>> permission.
>>
>>
>>
>> Regards,
>>
>> Vikas
>>
>>
>>
>> *From:* Ted Yu [mailto:yuzhihong@gmail.com]
>> *Sent:* 08 November 2017 11:40
>>
>> *To:* user@kylin.apache.org
>> *Subject:* Re: Error - Step Name: Load HFile to HBase Table
>>
>>
>>
>> This message originated from outside our organisation and is from web
>> based email - yuzhihong@gmail.com
>>
>> The file path was not shown in the picture.
>>
>>
>>
>> Make sure you use the same encryption zone for bulk load.
>>
>>
>>
>> On Wed, Nov 8, 2017 at 3:34 AM, <Vikash.Tandon@barclaycard.co.uk> wrote:
>>
>> Hi,
>>
>>
>>
>> Thanks for your note. We checked region log and noticed below error.
>>
>>
>>
>> Please can I request for your attention to resolve this issue.
>>
>>
>>
>> Regards.
>>
>> Vikas
>>
>>
>>
>>
>>
>> *From:* Ted Yu [mailto:yuzhihong@gmail.com]
>> *Sent:* 05 November 2017 10:09
>> *To:* user@kylin.apache.org
>> *Subject:* Re: Error - Step Name: Load HFile to HBase Table
>>
>>
>>
>> This message originated from outside our organisation and is from web
>> based email - yuzhihong@gmail.com
>>
>> Vikash:
>>
>>
>>
>> java.io.IOException: Retry attempted 10 times without completing, bailing
>> out
>>         at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBu
>> lkLoad(LoadIncrementalHFiles.java:446)
>>
>>
>>
>> Have you checked region server log(s) to see if there was some clue ?
>>
>>
>>
>> Was there anything else w.r.t. bulk load in Kylin's log ?
>>
>>
>>
>> Cheers
>>
>> This email and any attachments are confidential and intended solely for
>> the addressee and may also be privileged or exempt from disclosure under
>> applicable law. If you are not the addressee, or have received this email
>> in error, please notify the sender and immediately delete it from your
>> system. Do not copy, use, disclose or otherwise act upon any part of this
>> email or its attachments.
>>
>> Internet communications are not guaranteed to be secure or virus-free.
>> The Barclays Group does not accept responsibility for any loss arising from
>> unauthorised access to, or interference with, any internet communications
>> by any third party, or from the transmission of any viruses. Replies to
>> this email may be monitored by the Barclays Group for operational or
>> business reasons.
>>
>> Any opinion or other information in this email or its attachments that
>> does not relate to the business of the Barclays Group is personal to the
>> sender and is not given or endorsed by the Barclays Group.
>>
>> Barclaycard is a trading name of Barclays Bank PLC. Registered in
>> England. Registered No: 1026167. Registered Office: 1 Churchill Place,
>> London, E14 5HP. Barclays Bank PLC is authorised by the Prudential
>> Regulation Authority and regulated by the Financial Conduct Authority and
>> the Prudential Regulation Authority (Financial Services Register No.
>> 122702).
>>
>>
>>
>> This email and any attachments are confidential and intended solely for
>> the addressee and may also be privileged or exempt from disclosure under
>> applicable law. If you are not the addressee, or have received this email
>> in error, please notify the sender and immediately delete it from your
>> system. Do not copy, use, disclose or otherwise act upon any part of this
>> email or its attachments.
>>
>> Internet communications are not guaranteed to be secure or virus-free.
>> The Barclays Group does not accept responsibility for any loss arising from
>> unauthorised access to, or interference with, any internet communications
>> by any third party, or from the transmission of any viruses. Replies to
>> this email may be monitored by the Barclays Group for operational or
>> business reasons.
>>
>> Any opinion or other information in this email or its attachments that
>> does not relate to the business of the Barclays Group is personal to the
>> sender and is not given or endorsed by the Barclays Group.
>>
>> Barclaycard is a trading name of Barclays Bank PLC. Registered in
>> England. Registered No: 1026167. Registered Office: 1 Churchill Place,
>> London, E14 5HP. Barclays Bank PLC is authorised by the Prudential
>> Regulation Authority and regulated by the Financial Conduct Authority and
>> the Prudential Regulation Authority (Financial Services Register No.
>> 122702).
>>
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message