hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "James Clampffer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8765) Implement local block reader in libhdfspp
Date Wed, 10 Feb 2016 20:42:18 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

James Clampffer updated HDFS-8765:
----------------------------------
    Attachment: short-circuit-demo.patch4

Rebased to head again.  I haven't really touched this since the last rebase; though I should
have some more time to spend on it in the next 2-3 weeks.

Todo:
-a lot of dead printf/cout style debugging code can be removed
-lots of easy whitespace/formatting fixes
-make sure the block TokenProto gets passed over the domain socket
-If passing the tokenproto doesn't help it looks like some kernel debugging is going to be
required to figure out what's dropping the ancillary data (fds)

> Implement local block reader in libhdfspp
> -----------------------------------------
>
>                 Key: HDFS-8765
>                 URL: https://issues.apache.org/jira/browse/HDFS-8765
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs-client
>            Reporter: James Clampffer
>            Assignee: James Clampffer
>         Attachments: short-circuit-demo.patch2, short-circuit-demo.patch3, short-circuit-demo.patch4,
short_circuit_demo.patch
>
>
> Implement a block reader that uses the hdfs short circuit protocol to read colocated
data as efficiently as possible.  Implementation will be based on BlockReaderLocal.java +
the associated JNI bindings.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message