spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cxzl25 <...@git.apache.org>
Subject [GitHub] spark issue #21164: [SPARK-24098][SQL] ScriptTransformationExec should wait ...
Date Tue, 05 Jun 2018 14:18:26 GMT
Github user cxzl25 commented on the issue:

    https://github.com/apache/spark/pull/21164
  
    @liutang123  cc @cloud-fan @gatorsmile 
    
    I also encountered this problem.
    
    ![image](https://user-images.githubusercontent.com/3898450/40981493-9b0b0d46-690d-11e8-8607-c14756610d59.png)
    python:
    ```python
    import sys
    for line in sys.stdin:
        print 1/0
    ```
    sql:
    ```sql
    ADD FILE test.py;
    SELECT TRANSFORM(1) USING 'python test.py'
    AS (c1)
    ```
    
    I solved it this way:  *writerThread.join()*
    ```java
    if (scriptOutputReader.next(scriptOutputWritable) <= 0) {
        writerThread.join()
        checkFailureAndPropagate()
        return false
    }
    ```



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message