Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 53EEF200AF6 for ; Sat, 28 May 2016 05:02:15 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 53672160A3B; Sat, 28 May 2016 03:02:15 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 77C95160A38 for ; Sat, 28 May 2016 05:02:14 +0200 (CEST) Received: (qmail 45538 invoked by uid 500); 28 May 2016 03:02:13 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 45518 invoked by uid 99); 28 May 2016 03:02:13 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 28 May 2016 03:02:13 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 17E3C2C1F62 for ; Sat, 28 May 2016 03:02:13 +0000 (UTC) Date: Sat, 28 May 2016 03:02:13 +0000 (UTC) From: "Hadoop QA (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ACCUMULO-4165) Create a user level API for RFile MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Sat, 28 May 2016 03:02:15 -0000 [ https://issues.apache.org/jira/browse/ACCUMULO-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305128#comment-15305128 ] Hadoop QA commented on ACCUMULO-4165: ------------------------------------- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 1s {color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s {color} | {color:green} The patch appears to include 1 new or modified test files. {color} | | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 27s {color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m 40s {color} | {color:green} 1.8 passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 12s {color} | {color:green} 1.8 passed with JDK v1.8.0 {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 54s {color} | {color:green} 1.8 passed with JDK v1.7.0_79 {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 13s {color} | {color:green} 1.8 passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 34s {color} | {color:green} 1.8 passed {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 58s {color} | {color:green} 1.8 passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s {color} | {color:green} 1.8 passed with JDK v1.8.0 {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 59s {color} | {color:green} 1.8 passed with JDK v1.7.0_79 {color} | | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 15s {color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m 57s {color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 4s {color} | {color:green} the patch passed with JDK v1.8.0 {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 4s {color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 50s {color} | {color:green} the patch passed with JDK v1.7.0_79 {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 50s {color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 13s {color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m 25s {color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s {color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m 44s {color} | {color:green} the patch passed {color} | | {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m 35s {color} | {color:red} core-jdk1.8.0 with JDK v1.8.0 generated 1 new + 1 unchanged - 0 fixed = 2 total (was 1) {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 1s {color} | {color:green} the patch passed with JDK v1.7.0_79 {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 13m 4s {color} | {color:green} root in the patch passed with JDK v1.8.0. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 12m 46s {color} | {color:green} root in the patch passed with JDK v1.7.0_79. {color} | | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 13s {color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 49m 15s {color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | JIRA Issue | ACCUMULO-4165 | | GITHUB PR | https://github.com/apache/accumulo/pull/103 | | Optional Tests | asflicense javac javadoc unit findbugs checkstyle compile | | uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-ACCUMULO-Build/test_framework/yetus-0.3.0/lib/precommit/personality/accumulo.sh | | git revision | 1.8 / 85ff374 | | Default Java | 1.7.0_79 | | Multi-JDK versions | /home/jenkins/tools/java/jdk1.8.0:1.8.0 /usr/local/jenkins/java/jdk1.7.0_79:1.7.0_79 | | findbugs | v3.0.1 | | javadoc | https://builds.apache.org/job/PreCommit-ACCUMULO-Build/24/artifact/patchprocess/diff-javadoc-javadoc-core-jdk1.8.0.txt | | JDK v1.7.0_79 Test Results | https://builds.apache.org/job/PreCommit-ACCUMULO-Build/24/testReport/ | | modules | C: core server/tserver U: . | | Console output | https://builds.apache.org/job/PreCommit-ACCUMULO-Build/24/console | | Powered by | Apache Yetus 0.3.0 http://yetus.apache.org | This message was automatically generated. > Create a user level API for RFile > --------------------------------- > > Key: ACCUMULO-4165 > URL: https://issues.apache.org/jira/browse/ACCUMULO-4165 > Project: Accumulo > Issue Type: Improvement > Reporter: Keith Turner > Assignee: Keith Turner > Priority: Blocker > Fix For: 1.8.0 > > Time Spent: 2h > Remaining Estimate: 0h > > Users can bulk import RFiles. Currently the only way users can create RFiles using Accumulo's public API is via AccumuloFileOutputFormat. There is no way to read RFiles in the public API. Also, the internal APIs for reading and writing RFiles are cumbersome to use. > I am experimenting with a simple RFile API like the following. Below is an example of writing data. > {code:java} > LocalFileSystem localFs = FileSystem.getLocal(new Configuration()); > RFileWriter writer = RFileFactory.newWriter() > .withFileName("/tmp/test100M.rf") > .withFileSystem(localFs).build(); > writer.startDefaultLocalityGroup(); > for (int r = 0; r < 10000000; r++) { > for (int cq = 0; cq < 10; cq++) { > writer.append(genKey(r, cq), genVal(r, cq)); > } > } > writer.close(); > {code} > Below is an example of reading data. > {code:java} > LocalFileSystem localFs = FileSystem.getLocal(new Configuration()); > Scanner scanner = RFileFactory.newScanner() > .withFileName("/tmp/test100M.rf") > .withFileSystem(localFs) > .withDataCache(250000000) > .withIndexCache(1000000).build(); > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)