From reviews-return-656365-archive-asf-public=cust-asf.ponee.io@spark.apache.org  Tue Jun  5 16:18:29 2018
Return-Path: <reviews-return-656365-archive-asf-public=cust-asf.ponee.io@spark.apache.org>
X-Original-To: archive-asf-public@cust-asf.ponee.io
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by mx-eu-01.ponee.io (Postfix) with SMTP id 73AB0180625
	for <archive-asf-public@cust-asf.ponee.io>; Tue,  5 Jun 2018 16:18:28 +0200 (CEST)
Received: (qmail 3292 invoked by uid 500); 5 Jun 2018 14:18:27 -0000
Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:reviews-help@spark.apache.org>
List-Unsubscribe: <mailto:reviews-unsubscribe@spark.apache.org>
List-Post: <mailto:reviews@spark.apache.org>
List-Id: <reviews.spark.apache.org>
Delivered-To: mailing list reviews@spark.apache.org
Received: (qmail 3281 invoked by uid 99); 5 Jun 2018 14:18:26 -0000
Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Jun 2018 14:18:26 +0000
Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33)
	id 7DA8EDFB19; Tue,  5 Jun 2018 14:18:26 +0000 (UTC)
From: cxzl25 <git@git.apache.org>
To: reviews@spark.apache.org
Reply-To: reviews@spark.apache.org
References: <git-pr-21164-spark@git.apache.org>
In-Reply-To: <git-pr-21164-spark@git.apache.org>
Subject: [GitHub] spark issue #21164: [SPARK-24098][SQL] ScriptTransformationExec should wait ...
Content-Type: text/plain
Message-Id: <20180605141826.7DA8EDFB19@git1-us-west.apache.org>
Date: Tue,  5 Jun 2018 14:18:26 +0000 (UTC)

Github user cxzl25 commented on the issue:

    https://github.com/apache/spark/pull/21164
  
    @liutang123  cc @cloud-fan @gatorsmile 
    
    I also encountered this problem.
    
    ![image](https://user-images.githubusercontent.com/3898450/40981493-9b0b0d46-690d-11e8-8607-c14756610d59.png)
    python:
    ```python
    import sys
    for line in sys.stdin:
        print 1/0
    ```
    sql:
    ```sql
    ADD FILE test.py;
    SELECT TRANSFORM(1) USING 'python test.py'
    AS (c1)
    ```
    
    I solved it this way:  *writerThread.join()*
    ```java
    if (scriptOutputReader.next(scriptOutputWritable) <= 0) {
        writerThread.join()
        checkFailureAndPropagate()
        return false
    }
    ```



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org