spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vadim Semenov <va...@datadoghq.com>
Subject Re: [SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle
Date Tue, 12 Mar 2019 14:36:12 GMT
I/We have seen this error before on 1.6 but ever since we upgraded to 2.1
two years ago we haven't seen it

On Tue, Mar 12, 2019 at 2:19 AM wangfei <hzfeiwang@163.com> wrote:

> Hi all,
>      Non-deterministic FAILED_TO_UNCOMPRESS(5) or ’Stream is corrupted’  errors
> may occur during shuffle read, described as this JIRA(
> https://issues.apache.org/jira/browse/SPARK-4105).
>      There is not new comment for a long time in this JIRA.  So,  Is there
> anyone seen these errors in latest version, such as spark-2.3?
>      Can anyone provide a reproducible case or  analyze the cause of these
> errors?
>      Thanks.
>


-- 
Sent from my iPhone

Mime
View raw message