hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "He Yongqiang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-2335) Indexes are still automatically queried when out of sync with their source tables
Date Thu, 18 Aug 2011 07:12:27 GMT

    [ https://issues.apache.org/jira/browse/HIVE-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086844#comment-13086844
] 

He Yongqiang commented on HIVE-2335:
------------------------------------

Can you fix the errors output by the new testcases?

    [junit] Begin query: index_stale.q
    [junit] Deleted file:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/temp
    [junit] Deleted file:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/default__temp_temp_index__
    [junit] Deleted file:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/temp
    [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime
-I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I
transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun
-I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I grantTime -I [.][.][.] [0-9]* more
-I USING 'java -cp /data/users/heyongqiang/hive-trunk-commit/build/ql/test/logs/clientpositive/index_stale.q.out
/data/users/heyongqiang/hive-trunk-commit/ql/src/test/results/clientpositive/index_stale.q.out
    [junit] junit.framework.AssertionFailedError: Client execution results failed with error
code = 1
    [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
    [junit] 	at junit.framework.Assert.fail(Assert.java:47)
    [junit] 	at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_stale(TestCliDriver.java:130)
    [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
    [junit] 	at junit.framework.TestCase.runTest(TestCase.java:154)
    [junit] 	at junit.framework.TestCase.runBare(TestCase.java:127)
    [junit] 	at junit.framework.TestResult$1.protect(TestResult.java:106)
    [junit] 	at junit.framework.TestResult.runProtected(TestResult.java:124)
    [junit] 	at junit.framework.TestResult.run(TestResult.java:109)
    [junit] 	at junit.framework.TestCase.run(TestCase.java:118)
    [junit] 	at junit.framework.TestSuite.runTest(TestSuite.java:208)
    [junit] 	at junit.framework.TestSuite.run(TestSuite.java:203)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)
    [junit] 29c29
    [junit] < PREHOOK: type: ALTERINDEX_REBUILD
    [junit] ---
    [junit] > PREHOOK: type: QUERY
    [junit] 33c33
    [junit] < POSTHOOK: type: ALTERINDEX_REBUILD
    [junit] ---
    [junit] > POSTHOOK: type: QUERY
    [junit] Exception: Client execution results failed with error code = 1
    [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
    [junit] Begin query: index_stale_partitioned.q
    [junit] Deleted pfile:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/temp/foo=bar
    [junit] Deleted pfile:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/default__temp_temp_index__/foo=bar
    [junit] Deleted pfile:/data/users/heyongqiang/hive-trunk-commit/build/ql/test/data/warehouse/temp/foo=bar
    [junit] diff -a -I file: -I pfile: -I hdfs: -I /tmp/ -I invalidscheme: -I lastUpdateTime
-I lastAccessTime -I [Oo]wner -I CreateTime -I LastAccessTime -I Location -I LOCATION ' -I
transient_lastDdlTime -I last_modified_ -I java.lang.RuntimeException -I at org -I at sun
-I at java -I at junit -I Caused by: -I LOCK_QUERYID: -I grantTime -I [.][.][.] [0-9]* more
-I USING 'java -cp /data/users/heyongqiang/hive-trunk-commit/build/ql/test/logs/clientpositive/index_stale_partitioned.q.out
/data/users/heyongqiang/hive-trunk-commit/ql/src/test/results/clientpositive/index_stale_partitioned.q.out
    [junit] junit.framework.AssertionFailedError: Client execution results failed with error
code = 1
    [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more
logs.
    [junit] 	at junit.framework.Assert.fail(Assert.java:47)
    [junit] 	at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_stale_partitioned(TestCliDriver.java:178)
    [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    [junit] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    [junit] 	at java.lang.reflect.Method.invoke(Method.java:597)
    [junit] 	at junit.framework.TestCase.runTest(TestCase.java:154)
    [junit] 	at junit.framework.TestCase.runBare(TestCase.java:127)
    [junit] 	at junit.framework.TestResult$1.protect(TestResult.java:106)
    [junit] 	at junit.framework.TestResult.runProtected(TestResult.java:124)
    [junit] 	at junit.framework.TestResult.run(TestResult.java:109)
    [junit] 	at junit.framework.TestCase.run(TestCase.java:118)
    [junit] 	at junit.framework.TestSuite.runTest(TestSuite.java:208)
    [junit] 	at junit.framework.TestSuite.run(TestSuite.java:203)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)
    [junit] 38c38
    [junit] < PREHOOK: type: ALTERINDEX_REBUILD
    [junit] ---
    [junit] > PREHOOK: type: QUERY
    [junit] 42c42
    [junit] < POSTHOOK: type: ALTERINDEX_REBUILD
    [junit] ---
    [junit] > POSTHOOK: type: QUERY


> Indexes are still automatically queried when out of sync with their source tables
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-2335
>                 URL: https://issues.apache.org/jira/browse/HIVE-2335
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Syed S. Albiz
>            Assignee: Syed S. Albiz
>         Attachments: HIVE-2335.1.patch, HIVE-2335.2.patch
>
>
> The automatic index usage does not check whether or not the indexes are still up-to-date
when generating the index queries. This can be addressed in two stages, the first is to add
a check before generating the index query to ensure that the index is still valid. The next
stage may be to add some sort of mode where indexes are automatically updated on table writes.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message