hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21339) LLAP: Cache hit also initializes an FS object
Date Fri, 08 Mar 2019 21:42:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth Jayachandran updated HIVE-21339:
-----------------------------------------
    Attachment: HIVE-21339.4.patch

> LLAP: Cache hit also initializes an FS object 
> ----------------------------------------------
>
>                 Key: HIVE-21339
>                 URL: https://issues.apache.org/jira/browse/HIVE-21339
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>    Affects Versions: 4.0.0
>            Reporter: Gopal V
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-21339.1.patch, HIVE-21339.2.patch, HIVE-21339.3.patch, HIVE-21339.4.patch,
llap-cache-fs-get.png, llap-query7-cached.svg
>
>
> https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java#L214
> {code}
>     // 1. Get file metadata from cache, or create the reader and read it.
>     // Don't cache the filesystem object for now; Tez closes it and FS cache will fix
all that
>     fs = split.getPath().getFileSystem(jobConf);
>     fileKey = determineFileId(fs, split,
>         HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_ALLOW_SYNTHETIC_FILEID),
>         HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_DEFAULT_FS_FILE_ID),
>         !HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_IO_USE_FILEID_PATH)
>         );
> {code}
>  !llap-cache-fs-get.png! 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message