spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <>
Subject [jira] [Created] (SPARK-21490) SparkLauncher may fail to redirect streams
Date Thu, 20 Jul 2017 20:55:00 GMT
Marcelo Vanzin created SPARK-21490:

             Summary: SparkLauncher may fail to redirect streams
                 Key: SPARK-21490
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.2.0
            Reporter: Marcelo Vanzin
            Priority: Minor

While investigating a different issue, I noticed that the redirection handling in SparkLauncher
is faulty.

In the default case or when users use only log redirection, things should work fine.

But if users try to redirect just the stdout of a child process without redirecting stderr,
the launcher won't detect that and the child process may hang because stderr is not being
read and its buffer fills up.

The code should detect these cases and redirect any streams that haven't been explicitly redirected
by the user.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message