hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-13916) Document how downstream clients should make use of the new shaded client artifacts
Date Tue, 29 Aug 2017 14:29:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145377#comment-16145377
] 

Sean Busbey edited comment on HADOOP-13916 at 8/29/17 2:28 PM:
---------------------------------------------------------------

I need a PMC member to request a new repo, {{hadoop-downstreamer}}, using the [asf infra self
service tool|https://selfserve.apache.org/git.html]. then I can post a review for a commit
to add stuff.

Here's my plan, someone ping if they want more:

* Generate a configurable number of test files written directly to HDFS (using SequenceFile
and/or Avro)
* Run a MapReduce job over said files to count number of entries
* Run a MapReduce job over said files to a simple aggregate and write results to HDFS



was (Author: busbey):
I need a PMC member to request a new repo, {{hadoop-downstream}}, using the [asf infra self
service tool|https://selfserve.apache.org/git.html]. then I can post a review for a commit
to add stuff.

Here's my plan, someone ping if they want more:

* Generate a configurable number of test files written directly to HDFS (using SequenceFile
and/or Avro)
* Run a MapReduce job over said files to count number of entries
* Run a MapReduce job over said files to a simple aggregate and write results to HDFS


> Document how downstream clients should make use of the new shaded client artifacts
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-13916
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13916
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: documentation
>    Affects Versions: 3.0.0-alpha2
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
>
> provide a quickstart that walks through using the new shaded dependencies with Maven
to create a simple downstream project.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message