crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Clément MATHIEU (JIRA) <>
Subject [jira] [Created] (CRUNCH-613) Fix FileTargetImplTest.testHandleOutputsMovesFilesToDestination instability
Date Tue, 19 Jul 2016 19:31:20 GMT
Clément MATHIEU created CRUNCH-613:

             Summary: Fix FileTargetImplTest.testHandleOutputsMovesFilesToDestination instability
                 Key: CRUNCH-613
             Project: Crunch
          Issue Type: Bug
          Components: Core
            Reporter: Clément MATHIEU
            Assignee: Josh Wills

{{FileTargetImplTest.testHandleOutputsMovesFilesToDestination}} consistently fails on my machine
because it relies on the erroneous assumption that {{handleOutputs}} will preserve part indexes
in file names.

If you are lucky the {{part-m-00000}} file created by the MR job will be copied to the destination
folder with the exact same name. However it just... luck. Final index only depends on  iterator
order which can vary from machine to machine (OS, FS, JDK etc.)

This test should be rewritten to not rely on a such erroneous assumption. 

This message was sent by Atlassian JIRA

View raw message