hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-6310) Fix a few minimr test failures
Date Tue, 28 Jan 2014 14:24:39 GMT

    [ https://issues.apache.org/jira/browse/HIVE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884175#comment-13884175
] 

Brock Noland commented on HIVE-6310:
------------------------------------

I checked on the slave nodes and there is plenty of space.

{noformat}
[hiveptest@ip-10-74-94-52 ~]$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/xvde1             40G  4.7G   33G  13% /
{noformat}

Below is the error messages for the two failed tests. Both times there is a runtime exception
followed by some hadoop exceptions.

http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912810566_/2014/01/28/000000/job_20140128044010447_0005_1390912971033_hiveptest_--+Test+join+on+three+tables+on+d...c.value%2529%2528Stage

{noformat}
Task TASKID="task_20140128044010447_0005_r_000000" TASK_TYPE="REDUCE" START_TIME="1390912978019"
SPLITS="" .
Task TASKID="task_20140128044010447_0005_r_000001" TASK_TYPE="REDUCE" START_TIME="1390912978081"
SPLITS="" .
Task TASKID="task_20140128044010447_0005_r_000002" TASK_TYPE="REDUCE" START_TIME="1390912978117"
SPLITS="" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0"
START_TIME="1390912978026" TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535"
HTTP_PORT="53633" LOCALITY="OFF_SWITCH" AVATAAR="VIRGIN" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_20140128044010447_0005_r_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_r_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912983112" HOSTNAME="host0\.foo\.com" ERROR="java\.lang\.IllegalArgumentException:
Null user
	at org\.apache\.hadoop\.security\.UserGroupInformation\.createRemoteUser(UserGroupInformation\.java:887)
	at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:241)
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0"
START_TIME="1390912974953" TRACKER_NAME="tracker_host0\.foo\.com:localhost/127\.0\.0\.1:60535"
HTTP_PORT="53633" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044010447_0005_m_000000" TASK_ATTEMPT_ID="attempt_20140128044010447_0005_m_000000_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912977965" HOSTNAME="host0\.foo\.com" ERROR="Map output
lost, rescheduling: getMapOutput(attempt_20140128044010447_0005_m_000000_0,2) failed :
org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException: Could not find taskTracker/hiveptest/jobcache/job_20140128044010447_0005/attempt_20140128044010447_0005_m_000000_0/output/file\.out\.index
in any of the configured local directories
	at org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathToRead(LocalDirAllocator\.java:429)
	at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathToRead(LocalDirAllocator\.java:160)
	at org\.apache\.hadoop\.mapred\.TaskTracker$MapOutputServlet\.doGet(TaskTracker\.java:4053)
	at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:707)
	at javax\.servlet\.http\.HttpServlet\.service(HttpServlet\.java:820)
	at org\.mortbay\.jetty\.servlet\.ServletHolder\.handle(ServletHolder\.java:511)
	at org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1221)
	at org\.apache\.hadoop\.http\.HttpServer$QuotingInputFilter\.doFilter(HttpServer\.java:914)
	at org\.mortbay\.jetty\.servlet\.ServletHandler$CachedChain\.doFilter(ServletHandler\.java:1212)
	at org\.mortbay\.jetty\.servlet\.ServletHandler\.handle(ServletHandler\.java:399)
	at org\.mortbay\.jetty\.security\.SecurityHandler\.handle(SecurityHandler\.java:216)
	at org\.mortbay\.jetty\.servlet\.SessionHandler\.handle(SessionHandler\.java:182)
	at org\.mortbay\.jetty\.handler\.ContextHandler\.handle(ContextHandler\.java:766)
	at org\.mortbay\.jetty\.webapp\.WebAppContext\.handle(WebAppContext\.java:450)
	at org\.mortbay\.jetty\.handler\.ContextHandlerCollection\.handle(ContextHandlerCollection\.java:230)
	at org\.mortbay\.jetty\.handler\.HandlerWrapper\.handle(HandlerWrapper\.java:152)
	at org\.mortbay\.jetty\.Server\.handle(Server\.java:322)
	at org\.mortbay\.jetty\.HttpConnection\.handleRequest(HttpConnection\.java:542)
	at org\.mortbay\.jetty\.HttpConnection$RequestHandler\.headerComplete(HttpConnection\.java:928)
	at org\.mortbay\.jetty\.HttpParser\.parseNext(HttpParser\.java:549)
	at org\.mortbay\.jetty\.HttpParser\.parseAvailable(HttpParser\.java:212)
	at org\.mortbay\.jetty\.HttpConnection\.handle(HttpConnection\.java:404)
	at org\.mortbay\.io\.nio\.SelectChannelEndPoint\.run(SelectChannelEndPoint\.java:410)
	at org\.mortbay\.thread\.QueuedThreadPool$PoolThread\.run(QueuedThreadPool\.java:582)
" .
{noformat}

http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-1059/failed/TestMinimrCliDriver-external_table_with_space_in_location_path.q-infer_bucket_sort_merge.q-auto_sortmerge_join_16.q-and-1-more/source/itests/qtest/target/tmp/history/done/version-1/localhost_1390912806507_/2014/01/28/000000/job_20140128044006356_0003_1390912970454_hiveptest_select+%250Aa.key+%252C+%250Aa.value+%252C+%250Ab.value...b.key%2529%2528Stage

{noformat}
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0"
START_TIME="1390912978252" TRACKER_NAME="tracker_host2\.foo\.com:localhost/127\.0\.0\.1:58706"
HTTP_PORT="37104" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000003" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000003_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912987227" HOSTNAME="host2\.foo\.com" ERROR="java\.lang\.NullPointerException
	at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.init(HiveInputFormat\.java:257)
	at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:439)
	at org\.apache\.hadoop\.hive\.ql\.io\.HiveInputFormat\.pushProjectionsAndFilters(HiveInputFormat\.java:432)
	at org\.apache\.hadoop\.hive\.ql\.io\.BucketizedHiveInputFormat\.getRecordReader(BucketizedHiveInputFormat\.java:71)
	at org\.apache\.hadoop\.mapred\.MapTask$TrackedRecordReader\.<init>(MapTask\.java:191)
	at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:412)
	at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366)
	at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
	at java\.security\.AccessController\.doPrivileged(Native Method)
	at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
	at org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190)
	at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0"
START_TIME="1390912978652" TRACKER_NAME="tracker_host1\.foo\.com:localhost/127\.0\.0\.1:59914"
HTTP_PORT="45568" LOCALITY="RACK_LOCAL" AVATAAR="VIRGIN" .
MapAttempt TASK_TYPE="MAP" TASKID="task_20140128044006356_0003_m_000006" TASK_ATTEMPT_ID="attempt_20140128044006356_0003_m_000006_0"
TASK_STATUS="FAILED" FINISH_TIME="1390912987977" HOSTNAME="host1\.foo\.com" ERROR="org\.apache\.hadoop\.util\.DiskChecker$DiskErrorException:
Could not find any valid local directory for output/spill0\.out
	at org\.apache\.hadoop\.fs\.LocalDirAllocator$AllocatorPerContext\.getLocalPathForWrite(LocalDirAllocator\.java:381)
	at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:146)
	at org\.apache\.hadoop\.fs\.LocalDirAllocator\.getLocalPathForWrite(LocalDirAllocator\.java:127)
	at org\.apache\.hadoop\.mapred\.MapOutputFile\.getSpillFileForWrite(MapOutputFile\.java:121)
	at org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.sortAndSpill(MapTask\.java:1397)
	at org\.apache\.hadoop\.mapred\.MapTask$MapOutputBuffer\.flush(MapTask\.java:1303)
	at org\.apache\.hadoop\.mapred\.MapTask\.runOldMapper(MapTask\.java:431)
	at org\.apache\.hadoop\.mapred\.MapTask\.run(MapTask\.java:366)
	at org\.apache\.hadoop\.mapred\.Child$4\.run(Child\.java:255)
	at java\.security\.AccessController\.doPrivileged(Native Method)
	at javax\.security\.auth\.Subject\.doAs(Subject\.java:396)
	at org\.apache\.hadoop\.security\.UserGroupInformation\.doAs(UserGroupInformation\.java:1190)
	at org\.apache\.hadoop\.mapred\.Child\.main(Child\.java:249)
{noformat}

> Fix a few minimr test failures
> ------------------------------
>
>                 Key: HIVE-6310
>                 URL: https://issues.apache.org/jira/browse/HIVE-6310
>             Project: Hive
>          Issue Type: Bug
>          Components: Testing Infrastructure
>    Affects Versions: 0.13.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>         Attachments: HIVE-6310.1.patch, HIVE-6310.2.patch, HIVE-6310.patch
>
>
> These test cases are:
> {code}
> ql/src/test/queries/clientpositive/import_exported_table.q
> ql/src/test/queries/clientpositive/load_hdfs_file_with_space_in_the_name.q
> ql/src/test/queries/clientpositive/root_dir_external_table.q
> {code}
> They are failing because of existing hdfs:///tmp/test, possible left over by other tests.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message