Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BE9E8200CA4 for ; Wed, 7 Jun 2017 21:54:10 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BD1CA160BD0; Wed, 7 Jun 2017 19:54:10 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0FF74160BBF for ; Wed, 7 Jun 2017 21:54:09 +0200 (CEST) Received: (qmail 45136 invoked by uid 500); 7 Jun 2017 19:54:07 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 45124 invoked by uid 99); 7 Jun 2017 19:54:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jun 2017 19:54:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6D351C002B for ; Wed, 7 Jun 2017 19:54:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.379 X-Spam-Level: X-Spam-Status: No, score=0.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Upf0J9mVB-jf for ; Wed, 7 Jun 2017 19:54:06 +0000 (UTC) Received: from mail-yw0-f180.google.com (mail-yw0-f180.google.com [209.85.161.180]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id C023B5F297 for ; Wed, 7 Jun 2017 19:54:05 +0000 (UTC) Received: by mail-yw0-f180.google.com with SMTP id 63so7011935ywr.0 for ; Wed, 07 Jun 2017 12:54:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=kwdfMnmUDjqVuU0f0yyStt1BY5ejfxSKiQY0PdrH+j0=; b=W/Oi1viindu853YmTIMNxZuu/c8rxrG5t8yfe/vn2boIZMsO8ga/TFa62S2FMSiNek AcW1S0C7LsFx+9OwQMFYXMf2E2W8XN2AZ3ZFN4re95cYw2Ddd6Q2XsFzRIGF47B0ChGp G1Iz3HGThe0ZVVo7g1ItgC5itIxNMhiyk/u4MdtIDvCOUQ2PfWqFn+CSylduzrf47xmC F4VjTjqjNVOfxfTEQ6/OI/gHFb3KcrIS/fBhKJaQXm0JekI6JBWLZVRIDiugrESIIgNb eiaVhf3MaPlqKWLdGeGliWScoKkFR2GAB9hV/bB5ncY2ut45MBUuFHgm18224RV0ntNn Cpqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=kwdfMnmUDjqVuU0f0yyStt1BY5ejfxSKiQY0PdrH+j0=; b=cSDNnyB6ktBjKlk0H/7q5UEPPeIsQPf6DZau66YdRu3FVFX0Fib/9PaZdEoCyfkWIb kqtwPypa+RlNQX3DfXLte2DyHHoOoWpvvZj+SmhfwU91bWNg1OyquI6MVmsDJcpfanUD G9CAprnGasDMwa5XjvLb/tln/KXqDCT0onBAAhPO4VCM6oqKZTVBkF/mB215p+4YjcjK zMGTmVC5LV9r+n9uvbaijo0uvuiQ4wORr3KSNIjFhvwzh0AAEBjnFufGW+3FMpQuVVJq rSxh5nFfqcayULvs/yFr8jm614wtGnf+z5KPvzPTo4MKQ1UY6veaIBXSzJ+63Dal3WZx BSnw== X-Gm-Message-State: AODbwcAtkXUP4id8/wOn8eHVPxcyA9gC7820s08bBrcwz55aK7x3hkVX kaONSIdxdm2H5tmh0DZl8DWXKbfkePYn X-Received: by 10.13.215.19 with SMTP id z19mr8719347ywd.192.1496865244450; Wed, 07 Jun 2017 12:54:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.145.143 with HTTP; Wed, 7 Jun 2017 12:54:03 -0700 (PDT) In-Reply-To: <58764d7e-e98f-3da5-88c4-27ab4a8fc918@gmail.com> References: <591E1006.7040003@gmail.com> <591F5BF7.9080600@gmail.com> <5920E174.1050802@gmail.com> <58764d7e-e98f-3da5-88c4-27ab4a8fc918@gmail.com> From: James Srinivasan Date: Wed, 7 Jun 2017 20:54:03 +0100 Message-ID: Subject: Re: ClientConfiguration using Kerberos & MapReduce To: user@accumulo.apache.org Content-Type: text/plain; charset="UTF-8" archived-at: Wed, 07 Jun 2017 19:54:10 -0000 [snip] >> Fortunately I found this: >> >> https://github.com/apache/hive/blob/master/accumulo-handler/src/java/org/apache/hadoop/hive/accumulo/mr/HiveAccumuloTableInputFormat.java >> >> Is it a good example of Accumulo + MapReduce that I can copy? > That one is definitely over-kill. There's a bit of reflection in there to > work around older versions of Accumulo. However, it should be an example of > something that does work with Kerberos authentication. > Also, take note that Hive uses the InputFormat regardless of the execution > engine (local, MapReduce, Tez, etc). There are some comments to that effect > in the code. You can likely simplify those methods/blocks as well :) Think those are two things I'll need to handle at some point anyways. I think I'm setting all the AccumuloInputFormat statics correctly, and see the DelegationToken in my job's and context's credentials. However, my custom InputFormat's createRecordReader function needs to connect to Accumulo to get some config. Am I right in thinking I need to convert the Hadoop wrapped token (kind=ACCUMULO_AUTH_TOKEN) into an Accumulo DelegationToken to create my connector? If so, how do I do that? Thanks very much, James