hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10388) Pure native hadoop client
Date Mon, 10 Mar 2014 11:23:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925666#comment-13925666

Steve Loughran commented on HADOOP-10388:

# +1 to avoid leading edge features that need practical experience in writing modern C++ code
to make use of. Some of us committers may have C/C++ skills, but they'll not be current. 
# I'd like it to build on OS/X so that mac builds catch regressions, even if isn't for production.
# I'm not up to date with C++ test frameworks; xUnit code always played up in the past (2003)
as tests weren't independent enough, and resource leakage never got picked up. Something good
that Jenkins could run against MiniDFS and MiniYARN clusters would be nice.

bq. c++ does not have good binary compatibility(mainly virtual method) issue, so we need to
be careful.
Assume destination-side build, source RPMs & debs with specific version binaries produced
by downstream packagers. Windows builds -which we should also support if possible- will need
locking down by the windows developer groups. That is "no guarantee of binary compatibility
across versions for  now"

> Pure native hadoop client
> -------------------------
>                 Key: HADOOP-10388
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10388
>             Project: Hadoop Common
>          Issue Type: New Feature
>            Reporter: Binglin Chang
> A pure native hadoop client has following use case/advantages:
> 1.  writing Yarn applications using c++
> 2.  direct access to HDFS, without extra proxy overhead, comparing to web/nfs interface.
> 3.  wrap native library to support more languages, e.g. python
> 4.  lightweight, small footprint compare to several hundred MB of JDK and hadoop library
with various dependencies.

This message was sent by Atlassian JIRA

View raw message