manifoldcf-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karl Wright (JIRA)" <>
Subject [jira] [Commented] (CONNECTORS-1162) Apache Kafka Output Connector
Date Fri, 19 Jun 2015 09:17:00 GMT


Karl Wright commented on CONNECTORS-1162:

Hi Tugba,

Some comments.

First, you should not reformat the Apache headers.  They are legal documents and must be left
alone for that reason.  You will need to copy the headers from some other place now to be
sure they are legally correct.

Second, it was very hard to read your diff because of the reformatting that was done.  In
general, the following rules apply:
(1) Commits are EITHER code changes or formatting changes, but NEVER both
(2) The standard for formatting is two spaces per indent, with no tabs

Some IDEs like Eclipse like to reformat everything all the time by default.  You should find
out how to turn that feature OFF if you are working on ManifoldCF.


> Apache Kafka Output Connector
> -----------------------------
>                 Key: CONNECTORS-1162
>                 URL:
>             Project: ManifoldCF
>          Issue Type: Wish
>    Affects Versions: ManifoldCF 1.8.1, ManifoldCF 2.0.1
>            Reporter: Rafa Haro
>            Assignee: Karl Wright
>              Labels: gsoc, gsoc2015
>             Fix For: ManifoldCF 1.10, ManifoldCF 2.2
>         Attachments: 1.JPG, 2.JPG
> Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality
of a messaging system, but with a unique design. A single Kafka broker can handle hundreds
of megabytes of reads and writes per second from thousands of clients.
> Apache Kafka is being used for a number of uses cases. One of them is to use Kafka as
a feeding system for streaming BigData processes, both in Apache Spark or Hadoop environment.
A Kafka output connector could be used for streaming or dispatching crawled documents or metadata
and put them in a BigData processing pipeline

This message was sent by Atlassian JIRA

View raw message