apex-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (APEXMALHAR-2087) Hive output module
Date Sun, 29 May 2016 01:02:12 GMT

    [ https://issues.apache.org/jira/browse/APEXMALHAR-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305714#comment-15305714
] 

ASF GitHub Bot commented on APEXMALHAR-2087:
--------------------------------------------

Github user tweise commented on a diff in the pull request:

    https://github.com/apache/incubator-apex-malhar/pull/289#discussion_r64996280
  
    --- Diff: hive/pom.xml ---
    @@ -0,0 +1,265 @@
    +<!--
    +
    +    Licensed to the Apache Software Foundation (ASF) under one
    +    or more contributor license agreements.  See the NOTICE file
    +    distributed with this work for additional information
    +    regarding copyright ownership.  The ASF licenses this file
    +    to you under the Apache License, Version 2.0 (the
    +    "License"); you may not use this file except in compliance
    +    with the License.  You may obtain a copy of the License at
    +
    +      http://www.apache.org/licenses/LICENSE-2.0
    +
    +    Unless required by applicable law or agreed to in writing,
    +    software distributed under the License is distributed on an
    +    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    +    KIND, either express or implied.  See the License for the
    +    specific language governing permissions and limitations
    +    under the License.
    +
    +-->
    +<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    +         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    +  <modelVersion>4.0.0</modelVersion>
    +
    +  <parent>
    +    <groupId>org.apache.apex</groupId>
    +    <artifactId>malhar</artifactId>
    +    <version>3.5.0-SNAPSHOT</version>
    +  </parent>
    +
    +  <artifactId>malhar-hive</artifactId>
    +  <name>Apache Apex Malhar Hive Support</name>
    +  <packaging>jar</packaging>
    +
    +  <properties>
    +    <checkstyle.console>true</checkstyle.console>
    +  </properties>
    +
    +  <build>
    +    <plugins>
    +      <!-- Publish tests jar -->
    +      <plugin>
    +        <groupId>org.apache.maven.plugins</groupId>
    +        <artifactId>maven-jar-plugin</artifactId>
    +        <version>2.4</version>
    +        <executions>
    +          <execution>
    +            <goals>
    +              <goal>test-jar</goal>
    +            </goals>
    +            <phase>package</phase>
    +          </execution>
    +        </executions>
    +      </plugin>
    +     <!-- create resource directory for xml javadoc-->
    +     <plugin>
    --- End diff --
    
    It would be terrific if we can centralize this doclet boilerplate code that repeats in
very module. Related to https://issues.apache.org/jira/browse/APEXCORE-435 


> Hive output module
> ------------------
>
>                 Key: APEXMALHAR-2087
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2087
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Yogi Devendra
>            Assignee: Yogi Devendra
>
> Currently, applications which needs to write to Hive have to include 2 operators FSPojoToHiveOperator,
HiveOperator from malhar-contrib in the application DAG. [First operator writes to HDFS; second
operator loads files from HDFS to hive].
> Proposal: to wrap these two operators into a Module/CompositeOperator. So that, end user
can directly include this module into application.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message