Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CE9CB1056A for ; Tue, 28 Jan 2014 14:24:44 +0000 (UTC) Received: (qmail 72754 invoked by uid 500); 28 Jan 2014 14:24:43 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 72634 invoked by uid 500); 28 Jan 2014 14:24:42 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 72338 invoked by uid 500); 28 Jan 2014 14:24:41 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 72220 invoked by uid 99); 28 Jan 2014 14:24:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Jan 2014 14:24:39 +0000 Date: Tue, 28 Jan 2014 14:24:39 +0000 (UTC) From: "Brock Noland (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-6310) Fix a few minimr test failures MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884175#comment-13884175 ] Brock Noland commented on HIVE-6310: ------------------------------------ I checked on the slave nodes and there is plenty of space. {noformat} [hiveptest@ip-10-74-94-52 ~]$ df -h Filesystem Size Used Avail Use% Mounted on /dev/xvde1 40G 4.7G 33G 13% / {noformat} Below is the error messages for the two failed tests. Both times there is a runtime exception followed by some hadoop exceptions. http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912810566_/2014/01/28/000000/job_20140128044010447_0005_1390912971033_hiveptest_--+Test+join+on+three+tables+on+d...c.value%2529%2528Stage {noformat} Task TASKID="task_20140128044010447_0005_r_000000" TASK_TYPE="REDUCE" START_TIME="1390912978019" SPLITS="" . Task TASKID="task_20140128044010447_0005_r_000001" TASK_TYPE="REDUCE" START_TIME="1390912978081" SPLITS="" . Task TASKID="task_20140128044010447_0005_r_000002" TASK_TYPE="REDUCE" START_TIME="1390912978117" SPLITS="" . ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0" START_TIME="1390912978026" TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535" HTTP_PORT="53633" LOCALITY="OFF_SWITCH" AVATAAR="VIRGIN" . ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1390912983112" HOSTNAME="host0\.foo\.com" ERROR="java\.lang\.IllegalArgumentException: Null user at org\.apache\.hadoop\.security\.UserGroupInformation\.createRemoteUser(UserGroupInformation\.java:887) at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:241) " . MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0" START_TIME="1390912974953" TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535" HTTP_PORT="53633" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" . MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0" TASK_STATUS="FAILED" FINISH_TIME="1390912977965" HOSTNAME="host0\.foo\.com" ERROR="Map output lost, rescheduling: getMapOutput(attempt_20140128044010447_0005_m_000000_0,2) failed : org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException: Could not find taskTracker/hiveptest/jobcache/job_20140128044010447_0005/attempt_20140128044010447_0005_m_000000_0/output/file\.out\.index in any of the configured local directories at org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathToRead(LocalDirAllocator\.java:429) at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathToRead(LocalDirAllocator\.java:160) at org\.apache\.hadoop\.mapred\.TaskTracker$MapOutputServlet\.doGet(TaskTracker\.java:4053) at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:707) at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:820) at org\.mortbay\.jetty\.servlet\.ServletHolder\.handle(ServletHolder\.java:511) at org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1221) at org\.apache\.hadoop\.http\.HttpServer$QuotingInputFilter\.doFilter(HttpServer\.java:914) at org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1212) at org\.mortbay\.jetty\.servlet\.ServletHandler\.handle(ServletHandler\.java:399) at org\.mortbay\.jetty\.security\.SecurityHandler\.handle(SecurityHandler\.java:216) at org\.mortbay\.jetty\.servlet\.SessionHandler\.handle(SessionHandler\.java:182) at org\.mortbay\.jetty\.handler\.ContextHandler\.handle(ContextHandler\.java:766) at org\.mortbay\.jetty\.webapp\.WebAppContext\.handle(WebAppContext\.java:450) at org\.mortbay\.jetty\.handler\.ContextHandlerCollection\.handle(ContextHandlerCollection\.java:230) at org\.mortbay\.jetty\.handler\.HandlerWrapper\.handle(HandlerWrapper\.java:152) at org\.mortbay\.jetty\.Server\.handle(Server\.java:322) at org\.mortbay\.jetty\.HttpConnection\.handleRequest(HttpConnection\.java:542) at org\.mortbay\.jetty\.HttpConnection$RequestHandler\.headerComplete(HttpConnection\.java:928) at org\.mortbay\.jetty\.HttpParser\.parseNext(HttpParser\.java:549) at org\.mortbay\.jetty\.HttpParser\.parseAvailable(HttpParser\.java:212) at org\.mortbay\.jetty\.HttpConnection\.handle(HttpConnection\.java:404) at org\.mortbay\.io\.nio\.SelectChannelEndPoint\.run(SelectChannelEndPoint\.java:410) at org\.mortbay\.thread\.QueuedThreadPool$PoolThread\.run(QueuedThreadPool\.java:582) " . {noformat} http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-external_table_with_space_in_location_path.q-infer_bucket_sort_merge.q-auto_sortmerge_join_16.q-and-1-more/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912806507_/2014/01/28/000000/job_20140128044006356_0003_1390912970454_hiveptest_select+%250Aa.key+%252C+%250Aa.value+%252C+%250Ab.value...b.key%2529%2528Stage {noformat} MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0" START_TIME="1390912978252" TRACKER_NAME="tracker_host2\.foo\.com:localhost/127\.0\.0\.1:58706" HTTP_PORT="37104" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" . MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0" TASK_STATUS="FAILED" FINISH_TIME="1390912987227" HOSTNAME="host2\.foo\.com" ERROR="java\.lang\.NullPointerException at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.init(HiveInputFormat\.java:257) at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:439) at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:432) at org\.apache\.hadoop\.hive\.ql\.io\.BucketizedHiveInputFormat\.getRecordReader(BucketizedHiveInputFormat\.java:71) at org\.apache\.hadoop\.mapred\.MapTask$TrackedRecordReader\.(MapTask\.java:191) at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:412) at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366) at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255) at java\.security\.AccessController\.doPrivileged(Native Method) at javax\.security\.auth\.Subject\.doAs(Subject\.java:396) at org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190) at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249) " . MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0" START_TIME="1390912978652" TRACKER_NAME="tracker_host1\.foo\.com:localhost/127\.0\.0\.1:59914" HTTP_PORT="45568" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" . MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0" TASK_STATUS="FAILED" FINISH_TIME="1390912987977" HOSTNAME="host1\.foo\.com" ERROR="org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException: Could not find any valid local directory for output/spill0\.out at org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathForWrite(LocalDirAllocator\.java:381) at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:146) at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:127) at org\.apache\.hadoop\.mapred\.MapOutputFile\.getSpillFileForWrite(MapOutputFile\.java:121) at org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.sortAndSpill(MapTask\.java:1397) at org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.flush(MapTask\.java:1303) at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:431) at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366) at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255) at java\.security\.AccessController\.doPrivileged(Native Method) at javax\.security\.auth\.Subject\.doAs(Subject\.java:396) at org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190) at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249) {noformat} > Fix a few minimr test failures > ------------------------------ > > Key: HIVE-6310 > URL: https://issues.apache.org/jira/browse/HIVE-6310 > Project: Hive > Issue Type: Bug > Components: Testing Infrastructure > Affects Versions: 0.13.0 > Reporter: Xuefu Zhang > Assignee: Xuefu Zhang > Attachments: HIVE-6310.1.patch, HIVE-6310.2.patch, HIVE-6310.patch > > > These test cases are: > {code} > ql/src/test/queries/clientpositive/import_exported_table.q > ql/src/test/queries/clientpositive/load_hdfs_file_with_space_in_the_name.q > ql/src/test/queries/clientpositive/root_dir_external_table.q > {code} > They are failing because of existing hdfs:///tmp/test, possible left over by other tests. -- This message was sent by Atlassian JIRA (v6.1.5#6160)