Mailing-List: contact dev-help@reef.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@reef.apache.org
Date: Tue, 15 Dec 2015 06:40:46 +0000 (UTC)
From: "Julia (JIRA)" <jira@apache.org>
To: dev@reef.apache.org
Message-ID: <JIRA.12921887.1450161621000.23184.1450161646651@Atlassian.JIRA>
In-Reply-To: <JIRA.12921887.1450161621000@Atlassian.JIRA>
References: <JIRA.12921887.1450161621000@Atlassian.JIRA>
 <JIRA.12921887.1450161621694@arcas>
Subject: [jira] [Created] (REEF-1080) Make local temp file configurable in
 FileSystemInputPartition
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Julia created REEF-1080:
---------------------------

             Summary: Make local temp file configurable in FileSystemInputPartition
                 Key: REEF-1080
                 URL: https://issues.apache.org/jira/browse/REEF-1080
             Project: REEF
          Issue Type: Bug
            Reporter: Julia


Currently in FileSystemInputPartition, when download remote file to a local file before processing the data. The local file is based on Path.GetTempPath() which usually is a folder under C driver. There are multiple issues:
When file size is big, c: driver may not have enough space 
We would like the temp file to be deleted in the end, although we already implemented disposable to delete the temp file, and client should make sure it is called, there is still possibility the file is not cleared if the system suddenly crash. 
To resolve above issues, we would like to make the temp file folder for FileSystemInputPartition configurable, and default to the current working folder so that in case the system is crashed, the working folder will still be cleared. 


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)