apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXCORE-535) Node.teardown() should try to gracefully shutdown exectutor service
Date Thu, 15 Sep 2016 05:25:21 GMT

    [ https://issues.apache.org/jira/browse/APEXCORE-535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492426#comment-15492426
] 

ASF GitHub Bot commented on APEXCORE-535:
-----------------------------------------

GitHub user vrozov opened a pull request:

    https://github.com/apache/apex-core/pull/392

    APEXCORE-535 - Node.teardown() should try to gracefully shutdown exectutor service

    @tweise, @PramodSSImmaneni Please review.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/vrozov/apex-core APEXCORE-535

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/apex-core/pull/392.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #392
    
----
commit e924284ee026790bf60a0254d4bcdcf822a665ba
Author: Vlad Rozov <v.rozov@datatorrent.com>
Date:   2016-09-15T05:06:36Z

    APEXCORE-535 - Node.teardown() should try to gracefully shutdown exectutor service

----


> Node.teardown() should try to gracefully shutdown exectutor service
> -------------------------------------------------------------------
>
>                 Key: APEXCORE-535
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-535
>             Project: Apache Apex Core
>          Issue Type: Improvement
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>            Priority: Minor
>             Fix For: 3.5.0
>
>
> Forceful shutdown of the executor service leads to InterruptedException if asynchronous
checkpointing is in progress:
> {noformat}
> java.lang.InterruptedException
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Thread.join(Thread.java:1281)
>         at java.lang.Thread.join(Thread.java:1355)
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:456)
>         at org.apache.hadoop.util.Shell.run(Shell.java:379)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>         at org.apache.hadoop.util.Shell.execCommand(Shell.java:678)
>         at org.apache.hadoop.util.Shell.execCommand(Shell.java:661)
>         at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:639)
>         at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:305)
>         at org.apache.hadoop.fs.FileSystem.primitiveCreate(FileSystem.java:1011)
>         at org.apache.hadoop.fs.DelegateToFileSystem.createInternal(DelegateToFileSystem.java:85)
>         at org.apache.hadoop.fs.ChecksumFs$ChecksumFSOutputSummer.<init>(ChecksumFs.java:344)
>         at org.apache.hadoop.fs.ChecksumFs.createInternal(ChecksumFs.java:390)
>         at org.apache.hadoop.fs.AbstractFileSystem.create(AbstractFileSystem.java:575)
>         at org.apache.hadoop.fs.FileContext$3.next(FileContext.java:676)
>         at org.apache.hadoop.fs.FileContext$3.next(FileContext.java:672)
>         at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
>         at org.apache.hadoop.fs.FileContext.create(FileContext.java:672)
>         at com.datatorrent.common.util.AsyncFSStorageAgent.copyToHDFS(AsyncFSStorageAgent.java:118)
>         at com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:667)
>         at com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:656)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> 2016-09-14 22:02:51,463 [Thread-2109] WARN  util.Shell run - Error reading the error
stream
> java.io.IOException: Stream closed
>         at java.io.BufferedReader.ensureOpen(BufferedReader.java:115)
>         at java.io.BufferedReader.readLine(BufferedReader.java:310)
>         at java.io.BufferedReader.readLine(BufferedReader.java:382)
>         at org.apache.hadoop.util.Shell$1.run(Shell.java:431)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message