drill-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-3205) Test framework should report actual values in case of failures
Date Thu, 28 May 2015 19:10:19 GMT
Hanifi Gunes created DRILL-3205:

             Summary: Test framework should report actual values in case of failures
                 Key: DRILL-3205
                 URL: https://issues.apache.org/jira/browse/DRILL-3205
             Project: Apache Drill
          Issue Type: Bug
          Components: Tools, Build & Test
    Affects Versions: 1.0.0
            Reporter: Hanifi Gunes
            Assignee: Steven Phillips

Test framework seems to report expected results alone. This makes it particularly hard to
investigate and reason about the problem. Even in case where test result matcher is un-ordered
we can report actual results if returned number of rows & columns is manageable (say r
x c ≤ 100)

{code:title=Sample test failure that reports expected result but not the actual value}
Tests run: 43, Failures: 0, Errors: 1, Skipped: 3, Time elapsed: 30.168 sec <<< FAILURE!
- in org.apache.drill.TestFunctionsQuery
testToCharFunction(org.apache.drill.TestFunctionsQuery)  Time elapsed: 0.112 sec  <<<
java.lang.Exception: Did not find expected record in result set: `DEC28_1` : 12,345,678,912,345,678,912.5567,
`DEC38_1` : 999999999999999999999999999.5, `DEC9_1` : 1,234.56, `DEC18_1` : 99999912399.9567,
`FLOAT8_1` : 1,234.56, `FLOAT8_2` : $1,234.50, 

	at org.apache.drill.DrillTestWrapper.compareResults(DrillTestWrapper.java:541)
	at org.apache.drill.DrillTestWrapper.compareUnorderedResults(DrillTestWrapper.java:295)
	at org.apache.drill.DrillTestWrapper.run(DrillTestWrapper.java:119)
	at org.apache.drill.TestBuilder.go(TestBuilder.java:125)
	at org.apache.drill.TestFunctionsQuery.testToCharFunction(TestFunctionsQuery.java:517)

This message was sent by Atlassian JIRA

View raw message