dlab-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vira Vitanska (Jira)" <j...@apache.org>
Subject [jira] [Updated] (DLAB-1823) [Branch-515][AWS][GCP][Zeppelin]: Playbooks flight/airbnb preparation Py2/Py3/R/Scala run with error for local/remote kernels
Date Thu, 11 Jun 2020 12:02:00 GMT

     [ https://issues.apache.org/jira/browse/DLAB-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vira Vitanska updated DLAB-1823:
--------------------------------
    Description: 
*Preconditions:*

1. Zeppelin is created on AWS/GCP

*Steps to reproduce:*

1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels

*Actual result:* 

1. Playbooks run with error

*Expected result:*

1. Playbooks run successful

------------------------------------------------------------------------------------------

(i) For GCP Playbook preparation fails only for airbnb see attachments
----
*AWS*

+Flight preparation Py2+
||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|

 +Flight preparation R+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|

+Flight preparation scala+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|

 +AIRBNB+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
----
 *GCP*

+AIRBNB+
||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color} (11/06/2020)|
||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
||EMR 6.0.0 py3|*runs with error* (09/06/2020|
||Spark py2|*runs with error* (04/06/2020)|
||Spark py3|*runs with error* (04/06/2020)|

  was:
*Preconditions:*

1. Zeppelin is created on AWS/GCP

*Steps to reproduce:*

1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels

*Actual result:* 

1. Playbooks run with error

*Expected result:*

1. Playbooks run successful

------------------------------------------------------------------------------------------

(i) For GCP Playbook preparation fails only for airbnb see attachments
----
*AWS*

+Flight preparation Py2+
||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|

 +Flight preparation R+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|

+Flight preparation scala+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|

 +AIRBNB+
||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
----
 *GCP*

+AIRBNB+
||Local py2|*runs with error* (11/06/2020)|
||Local py3|*runs with error* (11/06/2020)|
||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
||EMR 6.0.0 py3|*runs with error* (09/06/2020|
||Spark py2|*runs with error* (04/06/2020)|
||Spark py3|*runs with error* (04/06/2020)|


> [Branch-515][AWS][GCP][Zeppelin]: Playbooks flight/airbnb preparation Py2/Py3/R/Scala
run with error for local/remote kernels
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: DLAB-1823
>                 URL: https://issues.apache.org/jira/browse/DLAB-1823
>             Project: Apache DLab
>          Issue Type: Bug
>          Components: DLab Main
>            Reporter: Vira Vitanska
>            Assignee: Mykola Bodnar
>            Priority: Major
>              Labels: AWS, Debian, DevOps
>         Attachments: AIRBNB local-remote.png, GCP Preparation airbnb py2.png, GCP preparation
airbnb py3.png, Python 2 data preparation -local logs.txt, Python 2 data preparation-Spark-logs.txt,
Python 2 data preparation-local.png, Python 2 data preparation-spark.png, R data preparation
local remote logs.txt, Scala -py2-py3- local-remote.png, Scala py2-py3 remote-local logs.txt,
Verified-AWS-Local-Fight-R-Py3.png, Verified1-AWS-EMR530-AIRBNB-Prapare-Py2.png, Verified1-AWS-EMR530-AIRBNB-Prapare-Py3.png,
Verified1-AWS-EMR530-Flight-preparetion-PY2.png, Verified1-AWS-EMR6-AIRBNB-Prapare-Py2-py3.png,
Verified1-AWS-EMR6-Flight-Prepare-py2.png, Verified1-AWS-EMR6-Flight-R-Py2.png, Verified1-AWS-EMR6-Flight-R-Py3.png,
Verified1-AWS-EMR6-Flight-Scala-Py2.png, Verified1-AWS-EMR6-Flight-Scala-Py3.png, Verified1-AWS-Scala-Flight-Prepare-Py2.png,
Verified1-AWS-Scala-Flight-Prepare-Py3.png, Verified1-AWS-Spark-AIRBNB-Prepare-Py3.png, Verified1-AWS-Spark-Flight-Prapare-Py2.png,
Verified1-AWS-Spark-Flight-Prepare-Py2.png, Verified1-AWS-Spark-Flight-Prepare-Py3.png, Verified1-AWS-Spark-Flight-Prepare-R-py3.png,
Verified1-AWS-local-flight-prapare-Py2.png, Verified1-AWS-spark-flight-prepare-Scala-Py2.png,
Verified1-GCP-local-AIRBNB-py2.jpg, Verifight-AWS-Spark-AIRBNB-Prepare-Py2.png
>
>
> *Preconditions:*
> 1. Zeppelin is created on AWS/GCP
> *Steps to reproduce:*
> 1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
> *Actual result:* 
> 1. Playbooks run with error
> *Expected result:*
> 1. Playbooks run successful
> ------------------------------------------------------------------------------------------
> (i) For GCP Playbook preparation fails only for airbnb see attachments
> ----
> *AWS*
> +Flight preparation Py2+
> ||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
>  +Flight preparation R+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
> +Flight preparation scala+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
>  +AIRBNB+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
> ||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ----
>  *GCP*
> +AIRBNB+
> ||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
> ||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color} (11/06/2020)|
> ||EMR 5.30.0 py2|*runs with error* (09/06/2020)|
> ||EMR 5.30.0 py3|*runs with error* (09/06/2020)|
> ||EMR 6.0.0 py2|*runs with error* (09/06/2020) |
> ||EMR 6.0.0 py3|*runs with error* (09/06/2020|
> ||Spark py2|*runs with error* (04/06/2020)|
> ||Spark py3|*runs with error* (04/06/2020)|



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@dlab.apache.org
For additional commands, e-mail: dev-help@dlab.apache.org


Mime
View raw message