Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 57B6711905 for ; Wed, 18 Jun 2014 08:22:01 +0000 (UTC) Received: (qmail 65598 invoked by uid 500); 18 Jun 2014 08:22:01 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 65547 invoked by uid 500); 18 Jun 2014 08:22:01 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 65534 invoked by uid 99); 18 Jun 2014 08:22:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jun 2014 08:22:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jianshi.huang@gmail.com designates 209.85.220.178 as permitted sender) Received: from [209.85.220.178] (HELO mail-vc0-f178.google.com) (209.85.220.178) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 18 Jun 2014 08:21:59 +0000 Received: by mail-vc0-f178.google.com with SMTP id ij19so449540vcb.37 for ; Wed, 18 Jun 2014 01:21:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=8yVBy8f9LovTqSMfx+z5+2wix5uPTJLoJVVMKBWiY9Y=; b=0qAILfij5+PnxURWL+zHHpiqCV4LKWd7NDje3bvoOL/7lgbRU+XeZg3TuZxqBvYeVB dXQc2U6AL74p+dtM5tjv2EKCZ4vai/A4/bTTCwY11cNfrhtcDL5YHDCsMPobJ8hRuf2A sRAqXi9NF4C2UTaHFhxEeRMYWRA2cPgtLKQMxIZATZjzHHAukdCL0qR+aoFAIWQaO53y pX2P/+gBARRkvrHsIOcPSGf0xada3TnwVrppDwAa9yVC/2rmXXIXS4p993UpNG7Odtqk NV9DtHbaAfwogbda/6hZfH2rIxNv8wEC2YnLXWEZMO64H1AaesU5r8j4yN7wJ+TN4+P0 Zcyw== X-Received: by 10.220.202.69 with SMTP id fd5mr218514vcb.43.1403079694738; Wed, 18 Jun 2014 01:21:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.95.10 with HTTP; Wed, 18 Jun 2014 01:21:14 -0700 (PDT) From: Jianshi Huang Date: Wed, 18 Jun 2014 16:21:14 +0800 Message-ID: Subject: Set AccumuloFileOutputFormat to save data to HDFS files instead of writing to Accumulo directly To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=001a11c1be70cbeca104fc17f297 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1be70cbeca104fc17f297 Content-Type: text/plain; charset=UTF-8 Hi all, I saw this line in accumulo-1.6.0/examples/simple/src/main/java/org/apache/accumulo/examples/simple/mapreduce/bulk/BulkIngestExample.java AccumuloFileOutputFormat.setOutputPath(job, new Path(opts.workDir + "/files")); However, it seems setOutputPath is not in 1.6.0 http://accumulo.apache.org/1.6/apidocs/org/apache/accumulo/core/client/mapreduce/AccumuloOutputFormat.html So how can I write the mutations to HDFS files? I think it might be faster to import using importdirectory command. BTW, I think it's fastest to import if the mutation files are already (partially) sorted and partitioned, makes sense? -- Jianshi Huang LinkedIn: jianshi Twitter: @jshuang Github & Blog: http://huangjs.github.com/ --001a11c1be70cbeca104fc17f297 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi all,

I saw this line in accumulo-1.6= .0/examples/simple/src/main/java/org/apache/accumulo/examples/simple/mapred= uce/bulk/BulkIngestExample.java

=C2=A0=C2=A0Accumu= loFileOutputFormat.setOutputPath(job, new Path(opts.workDir + "/files&= quot;));

However, it seems setOutputPath is not in 1.6.0



So how can I write the mutations to HDFS= files? I think it might be faster to import using=C2=A0importdirectory com= mand.

BTW, I think it's fastest to import if t= he mutation files are already (partially) sorted and partitioned, makes sen= se?

--
Jianshi Huang

LinkedIn: jianshi
Twitte= r: @jshuang
Github & Blog: http://huangjs.github.com/
--001a11c1be70cbeca104fc17f297--