hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Íñigo Goiri (JIRA) <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15578) GridmixTestUtils uses the wrong staging directory in windows
Date Tue, 03 Jul 2018 16:18:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16531621#comment-16531621
] 

Íñigo Goiri commented on HADOOP-15578:
--------------------------------------

The main issue is that this is indirectly using a local path (hadoop.tmp.dir) as an HDFS path
for staging.
We may want to change the path for the staging area instead of just tweaking the Windows path.
Another option is to sanitize the Windows path to make it usable for HDFS.

> GridmixTestUtils uses the wrong staging directory in windows
> ------------------------------------------------------------
>
>                 Key: HADOOP-15578
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15578
>             Project: Hadoop Common
>          Issue Type: Test
>            Reporter: Íñigo Goiri
>            Assignee: Íñigo Goiri
>            Priority: Major
>         Attachments: HADOOP-15578.000.patch
>
>
> {{GridmixTestUtils#createHomeAndStagingDirectory}} gets the staging area from the configuration
key {{mapreduce.jobtracker.staging.root.dir}}. This variable depends on {{hadoop.tmp.dir}}
which in Windows is set to a local Windows folder. When the test tries to create the path
in HDFS it gets an error because the path is not compliant.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message