Return-Path: X-Original-To: apmail-apex-dev-archive@minotaur.apache.org Delivered-To: apmail-apex-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A3C3718D95 for ; Thu, 10 Mar 2016 09:19:35 +0000 (UTC) Received: (qmail 84359 invoked by uid 500); 10 Mar 2016 09:19:35 -0000 Delivered-To: apmail-apex-dev-archive@apex.apache.org Received: (qmail 84298 invoked by uid 500); 10 Mar 2016 09:19:35 -0000 Mailing-List: contact dev-help@apex.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@apex.incubator.apache.org Delivered-To: mailing list dev@apex.incubator.apache.org Received: (qmail 84286 invoked by uid 99); 10 Mar 2016 09:19:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2016 09:19:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id B012D18053A for ; Thu, 10 Mar 2016 09:19:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.349 X-Spam-Level: X-Spam-Status: No, score=-4.349 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.329] autolearn=disabled Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Otompv-gPq0t for ; Thu, 10 Mar 2016 09:19:33 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with SMTP id ABFD25F2C3 for ; Thu, 10 Mar 2016 09:19:32 +0000 (UTC) Received: (qmail 84281 invoked by uid 99); 10 Mar 2016 09:19:31 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2016 09:19:31 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 7C039DFBDE; Thu, 10 Mar 2016 09:19:31 +0000 (UTC) From: DT-Priyanka To: dev@apex.incubator.apache.org Reply-To: dev@apex.incubator.apache.org References: In-Reply-To: Subject: [GitHub] incubator-apex-malhar pull request: APEXMALHAR-2008: Create HDFS F... Content-Type: text/plain Message-Id: <20160310091931.7C039DFBDE@git1-us-west.apache.org> Date: Thu, 10 Mar 2016 09:19:31 +0000 (UTC) Github user DT-Priyanka commented on a diff in the pull request: https://github.com/apache/incubator-apex-malhar/pull/207#discussion_r55651968 --- Diff: library/src/main/java/com/datatorrent/lib/io/block/HDFSBlockReader.java --- @@ -0,0 +1,78 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +package com.datatorrent.lib.io.block; + +import java.io.IOException; +import java.net.URI; + +import org.apache.hadoop.fs.FileSystem; + +import com.google.common.base.Splitter; + +public class HDFSBlockReader extends FSSliceReader +{ + protected String uri; + + @Override + protected FileSystem getFSInstance() throws IOException + { + return FileSystem.newInstance(URI.create(uri), configuration); + } + + /** + * Sets the uri + * + * @param uri + */ + public void setUri(String uri) + { + this.uri = convertSchemeToLowerCase(uri); + } + + public String getUri() + { + return uri; + } + + /** + * Converts Scheme part of the URI to lower case. Multiple URI can be comma separated. If no scheme is there, no + * change is made. + * + * @param + * @return String with scheme part as lower case + */ + private static String convertSchemeToLowerCase(String uri) --- End diff -- Adding unit test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---