hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-513) IllegalStateException is thrown by TaskTracker
Date Fri, 29 Sep 2006 20:38:22 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-513?page=all ]

Owen O'Malley updated HADOOP-513:
---------------------------------

    Attachment: map-out-servlet.patch

This patch replaces the getMapOutput.jsp with a Servlet. 

The problem was that the getMapOutput.jsp was closing the output stream and the wrapper code
was trying to close it again, which would sometimes generate the IllegalStateException.

The new servlet is more careful to handle errors including setting an error response if something
goes wrong. It also sets the content-length with the length of the file.

> IllegalStateException is thrown by TaskTracker
> ----------------------------------------------
>
>                 Key: HADOOP-513
>                 URL: http://issues.apache.org/jira/browse/HADOOP-513
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.5.0
>            Reporter: Konstantin Shvachko
>         Assigned To: Owen O'Malley
>             Fix For: 0.7.0
>
>         Attachments: map-out-servlet.patch
>
>
> I am running TestDFSIO on a one node cluster and getting IllegalStateException for each
map task run as listed below.
> The same exceptions are flooding logs for TestMiniMRWithDFS on my nightly build for quite
a while now.
> Does anybody know what that is?
> My understanding is that if it is "illegal", then tests should fail.
> If not then it should be caught and ignored INTERNALLY.
> 06/09/06 14:54:50 INFO mapred.TaskTracker: task_0002_r_000000_0 0.25% reduce > copy
(3 of 4 at 0.00 MB/s) >
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Need 1 map output(s)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Got 1 known map output
location(s); scheduling...
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Scheduled 1 of 1 known
outputs (0 slow hosts and 0 dup hosts)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 Copying task_0002_m_000003_0
output from ENO.
> 06/09/06 14:54:50 WARN /: /getMapOutput.jsp?map=task_0002_m_000003_0&reduce=0:
> java.lang.IllegalStateException
>     at org.mortbay.jetty.servlet.ServletHttpResponse.getWriter(ServletHttpResponse.java:561)
>     at org.apache.jasper.runtime.JspWriterImpl.initOut(JspWriterImpl.java:122)
>     at org.apache.jasper.runtime.JspWriterImpl.flushBuffer(JspWriterImpl.java:115)
>     at org.apache.jasper.runtime.PageContextImpl.release(PageContextImpl.java:190)
>     at org.apache.jasper.runtime.JspFactoryImpl.internalReleasePageContext(JspFactoryImpl.java:115)
>     at org.apache.jasper.runtime.JspFactoryImpl.releasePageContext(JspFactoryImpl.java:75)
>     at org.apache.hadoop.mapred.getMapOutput_jsp._jspService(getMapOutput_jsp.java:100)
>     at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
>     at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:427)
>     at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationHandler.java:475)
>     at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:567)
>     at org.mortbay.http.HttpContext.handle(HttpContext.java:1565)
>     at org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationContext.java:635)
>     at org.mortbay.http.HttpContext.handle(HttpContext.java:1517)
>     at org.mortbay.http.HttpServer.service(HttpServer.java:954)
>     at org.mortbay.http.HttpConnection.service(HttpConnection.java:814)
>     at org.mortbay.http.HttpConnection.handleNext(HttpConnection.java:981)
>     at org.mortbay.http.HttpConnection.handle(HttpConnection.java:831)
>     at org.mortbay.http.SocketListener.handleConnection(SocketListener.java:244)
>     at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>     at org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
> 06/09/06 14:54:50 INFO mapred.TaskRunner: task_0002_r_000000_0 done copying task_0002_m_000003_0
output from ENO.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message