pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Niels Basjes (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-5343) Upgrade developer build environment
Date Fri, 22 Jun 2018 13:42:00 GMT

    [ https://issues.apache.org/jira/browse/PIG-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520364#comment-16520364

Niels Basjes commented on PIG-5343:

I'm still working on this because I'm having problems with what I have created so far.

I was trying to get PIG-2599 (Mavenize Pig) running and I got stuck on a large number of unit
tests that simply fail with hard to trace errors.
Get this  [https://github.com/nielsbasjes/MavenizePig] and the run.sh script will locally
create a rearranged version of the Pig source tree which compiles pig and piggybank.

So I decided to see how the ant based build works and compare where it goes wrong (i.e. this
issue popped up to fix the docker setup to do just that)

At this point my best guess is that there is a problem in relation to the PigServer + a 'non-local'
MiniCluster and the use of HDFS which cause jobs to fail under Java 1.8.

Try this one for example: in TestOrcStoragePushdown the BeforeClass method  createInputData
the very simple pigserver job to create the test file on HDFS fails and produces an empty
file (hence all subsequent tests in that file fail too).

It seems to be Java 1.7 / 1.8 related but at this point I'm stuck and I could use some help/pointers
where to look next.


Most importantly: Do you have these effects too? 




> Upgrade developer build environment
> -----------------------------------
>                 Key: PIG-5343
>                 URL: https://issues.apache.org/jira/browse/PIG-5343
>             Project: Pig
>          Issue Type: Improvement
>          Components: build
>            Reporter: Niels Basjes
>            Assignee: Niels Basjes
>            Priority: Major
>         Attachments: PIG-5343-1.patch, PIG-5343-2.patch
> The docker image that can be used to setup the build environment still uses Java 1.7
and is based on a very old version of Ubuntu.
> Both of these should be updated.

This message was sent by Atlassian JIRA

View raw message