pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4276) Fix ordering related failures in TestEvalPipeline for Spark
Date Tue, 21 Apr 2015 01:56:59 GMT

    [ https://issues.apache.org/jira/browse/PIG-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504152#comment-14504152
] 

Xuefu Zhang commented on PIG-4276:
----------------------------------

Actually if Pig semantics doesn't guarantee an order, the test shouldn't expect such an order
just because of certain execution happens to provides that. Thus, I'd favor doing sort-before-comparison
to validate test output when order is not deterministic. This is exactly what Hive on Spark
is doing.

> Fix ordering related failures in TestEvalPipeline for Spark
> -----------------------------------------------------------
>
>                 Key: PIG-4276
>                 URL: https://issues.apache.org/jira/browse/PIG-4276
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: liyunzhang_intel
>            Assignee: Mohit Sabharwal
>             Fix For: spark-branch
>
>         Attachments: PIG-4276.1.patch, PIG-4276.patch, TEST-org.apache.pig.test.TestEvalPipeline.txt
>
>
> error log is attached



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message