hawq-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergei Lebedev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAWQ-1624) Make libhdfs3 binary compatible with libhdfs
Date Sun, 17 Jun 2018 18:44:00 GMT

    [ https://issues.apache.org/jira/browse/HAWQ-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16515185#comment-16515185
] 

Sergei Lebedev commented on HAWQ-1624:
--------------------------------------

Answering the question above, yes the JVM library [seems to|https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/BlockReaderRemote.java#L243]
read-and-discard on skip.

> Make libhdfs3 binary compatible with libhdfs
> --------------------------------------------
>
>                 Key: HAWQ-1624
>                 URL: https://issues.apache.org/jira/browse/HAWQ-1624
>             Project: Apache HAWQ
>          Issue Type: Improvement
>          Components: libhdfs
>            Reporter: Sergei Lebedev
>            Assignee: Radar Lei
>            Priority: Minor
>
> libhdfs3 is almost binary compatible with libhdfs. The missing bits are:
> * libhdfs3 does not define hdfsPread which nonetheless can be implemented in terms of
hdfsTell, hdfsSeek and hdfsRead;
> * hdfsSync is called hdfsHSync in libhdfs3;
> * In libhdfs hdfsFlush flushes the internal buffer of the BufferedInputStream; in libhdfs3
it always flushes to HDFS, i.e. it does what hdfsHFlush should do. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message