spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "KaiXinXIaoLei (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-23405) The task will hang up when a small table left semi join a big table
Date Tue, 13 Feb 2018 09:26:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

KaiXinXIaoLei updated SPARK-23405:
----------------------------------
    Description: 
I run a sql: `select ls.cs_order_number from ls left semi join catalog_sales cs on ls.cs_order_number
= cs.cs_order_number`, The `ls` table is a small table ,and the number is one. The `catalog_sales`
table is a big table,  and the number is 10 billion. The task will be hang up:

!taskhang up.png!

 And the sql page is :

!SQL.png!

  was:
I run a sql: `select ls.cs_order_number from ls left semi join catalog_sales cs on ls.cs_order_number
= cs.cs_order_number`, The `ls` table is a small table ,and the number is one. The `catalog_sales`
table is a big table,  and the number is 10 billion. The task will be hang up:

!taskhang up.png!

 


> The task will hang up when a small table left semi join a big table
> -------------------------------------------------------------------
>
>                 Key: SPARK-23405
>                 URL: https://issues.apache.org/jira/browse/SPARK-23405
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.2.1
>            Reporter: KaiXinXIaoLei
>            Priority: Major
>         Attachments: SQL.png, taskhang up.png
>
>
> I run a sql: `select ls.cs_order_number from ls left semi join catalog_sales cs on ls.cs_order_number
= cs.cs_order_number`, The `ls` table is a small table ,and the number is one. The `catalog_sales`
table is a big table,  and the number is 10 billion. The task will be hang up:
> !taskhang up.png!
>  And the sql page is :
> !SQL.png!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message