Return-Path: X-Original-To: apmail-nifi-commits-archive@minotaur.apache.org Delivered-To: apmail-nifi-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA800107BA for ; Mon, 16 Feb 2015 22:30:38 +0000 (UTC) Received: (qmail 28405 invoked by uid 500); 16 Feb 2015 22:30:33 -0000 Delivered-To: apmail-nifi-commits-archive@nifi.apache.org Received: (qmail 28355 invoked by uid 500); 16 Feb 2015 22:30:33 -0000 Mailing-List: contact commits-help@nifi.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.incubator.apache.org Delivered-To: mailing list commits@nifi.incubator.apache.org Received: (qmail 28346 invoked by uid 99); 16 Feb 2015 22:30:33 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Feb 2015 22:30:33 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 16 Feb 2015 22:30:32 +0000 Received: (qmail 28014 invoked by uid 99); 16 Feb 2015 22:30:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 16 Feb 2015 22:30:12 +0000 Date: Mon, 16 Feb 2015 22:30:12 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: commits@nifi.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (NIFI-238) Add processors to write datasets using Kite MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/NIFI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323403#comment-14323403 ] ASF GitHub Bot commented on NIFI-238: ------------------------------------- Github user busbey commented on a diff in the pull request: https://github.com/apache/incubator-nifi/pull/24#discussion_r24780203 --- Diff: nifi/nifi-nar-bundles/nifi-kite-bundle/nifi-kite-processors/src/main/java/org/apache/nifi/processors/kite/AbstractKiteProcessor.java --- @@ -0,0 +1,217 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ + +package org.apache.nifi.processors.kite; + +import com.google.common.base.Splitter; +import com.google.common.collect.ImmutableList; +import com.google.common.io.Resources; +import java.io.IOException; +import java.io.InputStream; +import java.net.URI; +import java.net.URISyntaxException; +import java.util.List; +import org.apache.avro.Schema; +import org.apache.hadoop.conf.Configuration; +import org.apache.hadoop.fs.FileSystem; +import org.apache.hadoop.fs.Path; +import org.apache.nifi.components.PropertyDescriptor; +import org.apache.nifi.components.ValidationContext; +import org.apache.nifi.components.ValidationResult; +import org.apache.nifi.components.Validator; +import org.apache.nifi.processor.AbstractProcessor; +import org.apache.nifi.processor.ProcessContext; +import org.apache.nifi.processor.annotation.OnScheduled; +import org.apache.nifi.processor.util.StandardValidators; +import org.kitesdk.data.DatasetNotFoundException; +import org.kitesdk.data.Datasets; +import org.kitesdk.data.SchemaNotFoundException; +import org.kitesdk.data.URIBuilder; +import org.kitesdk.data.spi.DefaultConfiguration; + +public abstract class AbstractKiteProcessor extends AbstractProcessor { --- End diff -- this could be package-private. if we're leaving it public so that others can build their own Kite Processors on top of it, it should have some javadocs. > Add processors to write datasets using Kite > ------------------------------------------- > > Key: NIFI-238 > URL: https://issues.apache.org/jira/browse/NIFI-238 > Project: Apache NiFi > Issue Type: New Feature > Components: Extensions > Reporter: Ryan Blue > > I think it would be great to have a set of processors that parse incoming flow files and add the data to Kite datasets. -- This message was sent by Atlassian JIRA (v6.3.4#6332)