gearpump-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GEARPUMP-233) Add hbase-example
Date Thu, 10 Nov 2016 08:43:58 GMT

    [ https://issues.apache.org/jira/browse/GEARPUMP-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653454#comment-15653454
] 

ASF GitHub Bot commented on GEARPUMP-233:
-----------------------------------------

Github user manuzhang commented on a diff in the pull request:

    https://github.com/apache/incubator-gearpump/pull/107#discussion_r87349458
  
    --- Diff: examples/streaming/hbase/src/main/scala/org/apache/gearpump/streaming/examples/hbase/HBaseConn.scala
---
    @@ -0,0 +1,67 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *      http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.gearpump.streaming.examples.hbase
    +
    +import akka.actor.ActorSystem
    +import org.apache.gearpump.cluster.UserConfig
    +import org.apache.gearpump.cluster.client.ClientContext
    +import org.apache.gearpump.cluster.main.{ArgumentsParser, CLIOption, ParseResult}
    +import org.apache.gearpump.external.hbase.HBaseSink
    +import org.apache.gearpump.streaming.StreamApplication
    +import org.apache.gearpump.streaming.partitioner.HashPartitioner
    +import org.apache.gearpump.streaming.sink.DataSinkProcessor
    +import org.apache.gearpump.streaming.source.DataSourceProcessor
    +import org.apache.gearpump.util.Graph.Node
    +import org.apache.gearpump.util.{AkkaApp, Graph, LogUtil}
    +import org.slf4j.Logger
    +
    +object HBaseConn extends AkkaApp with ArgumentsParser {
    +  private val LOG: Logger = LogUtil.getLogger(getClass)
    +  val RUN_FOR_EVER = -1
    +
    +  override val options: Array[(String, CLIOption[Any])] = Array(
    +    "splitNum" -> CLIOption[Int]("<how many sum tasks>", required = false, defaultValue
= Some(1)),
    +    "sinkNum" -> CLIOption[Int]("<how many sum tasks>", required = false, defaultValue
= Some(1))
    +  )
    +
    +  def application(config: ParseResult, system: ActorSystem): StreamApplication = {
    +    implicit val actorSystem = system
    +
    +    val splitNum = config.getInt("splitNum")
    +    val sinkNum = config.getInt("sinkNum")
    +
    +    val split = new Split
    +    val sourceProcessor = DataSourceProcessor(split, splitNum, "Split")
    +    val sink = HBaseSink(UserConfig.empty, "intel")
    --- End diff --
    
    please do not use company name for the table name


> Add hbase-example
> -----------------
>
>                 Key: GEARPUMP-233
>                 URL: https://issues.apache.org/jira/browse/GEARPUMP-233
>             Project: Apache Gearpump
>          Issue Type: New Feature
>          Components: examples, hbase 
>            Reporter: Kaifang Bao
>            Assignee: Kaifang Bao
>            Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message