hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Miklos Gergely (JIRA)" <>
Subject [jira] [Updated] (HIVE-21516) Fix spark downloading for q tests
Date Wed, 27 Mar 2019 09:25:00 GMT


Miklos Gergely updated HIVE-21516:
    Attachment: HIVE-21516.03.patch

> Fix spark downloading for q tests
> ---------------------------------
>                 Key: HIVE-21516
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 3.1.1
>            Reporter: Miklos Gergely
>            Assignee: Miklos Gergely
>            Priority: Major
>             Fix For: 4.0.0
>         Attachments: HIVE-21516.01.patch, HIVE-21516.02.patch, HIVE-21516.03.patch
> Currently itests/pom.xml declares a command to generated the download script for spark,
thus it is re-generated every time any maven command is executed for any sub project of itests.
AS a side effect it is leaving files everywhere. The file is almost
totally static, no need to recreate it every time, just requires $spark.version as a parameter.
> Also it is only working properly under linux, as it relies on the md5sum program which
is not present in OS X. This means that if the spark tarball is partially downloaded on OS
X, then it would never be re-downloaded. This should be fixed by making it work as well using md5
on OS X.

This message was sent by Atlassian JIRA

View raw message