Return-Path: X-Original-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E3D9B18EE6 for ; Mon, 17 Aug 2015 21:29:36 +0000 (UTC) Received: (qmail 5809 invoked by uid 500); 17 Aug 2015 21:29:36 -0000 Delivered-To: apmail-hadoop-yarn-dev-archive@hadoop.apache.org Received: (qmail 5736 invoked by uid 500); 17 Aug 2015 21:29:36 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-dev@hadoop.apache.org Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 5724 invoked by uid 99); 17 Aug 2015 21:29:36 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 17 Aug 2015 21:29:36 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id B9E8D18210F for ; Mon, 17 Aug 2015 21:29:35 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id rdSExmyJDjEG for ; Mon, 17 Aug 2015 21:29:34 +0000 (UTC) Received: from mail-la0-f41.google.com (mail-la0-f41.google.com [209.85.215.41]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 46FAA42B1D for ; Mon, 17 Aug 2015 21:29:34 +0000 (UTC) Received: by labd1 with SMTP id d1so87953770lab.1 for ; Mon, 17 Aug 2015 14:29:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=zM4tZxEGyRu3izjNtl0VbBRUV5/oPUDfH3p8KJkirNA=; b=dNYrPB1Obnzrp5Ip0+Lx7828cJb09ZppEn0a1wFUsDoND59l6eFVoUDtSiQ5t4e+fT bKUu3KM3aQiEAEOfyM+qgC2AK/r2Mru3Y0Jp6NbusPQGRbx2JjXahmKXZxAgTN6Q8Kg0 EwKk8tncKpfNTQS7w9uBmKVhe8nOVV4iW7BlnwL00lYOa/YEFS6bI20aW9L7TPO91+dY 2xK6FFJ6B1Ivt0oDTcyuETwyTm3leM0+v7MOZ+WOfOhwiInvQKpL85Q6NbNj/b4+oe0F kdvUXadK2xP/1aqFAzU/poMJSsY+AwklbdzExc3pD3kCRVGiXOkYHXn7RDTUw+k/jezB On0A== X-Received: by 10.112.199.66 with SMTP id ji2mr2789213lbc.1.1439846967249; Mon, 17 Aug 2015 14:29:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.85.235 with HTTP; Mon, 17 Aug 2015 14:29:07 -0700 (PDT) From: Abhishek Das Date: Mon, 17 Aug 2015 14:29:07 -0700 Message-ID: Subject: location of leveldb in timeline server To: yarn-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c342bc0391f1051d887f75 --001a11c342bc0391f1051d887f75 Content-Type: text/plain; charset=UTF-8 Hi, By default, the leveldb for the timeline server resides on local disk (configurable via yarn.timeline-service.leveldb-timeline-store.path). Is it possible to configure the path to be a different file system ( say s3. the path is going to be s3:// --- ). I tried to set the path but its giving me the following error when I am trying to start the timelineserver. 15/08/17 11:52:39 INFO service.AbstractService: Service org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore failed in state INITED; cause: org.fusesource.leveldbjni.internal.NativeDB$DBException: IO error: No such file or directory org.fusesource.leveldbjni.internal.NativeDB$DBException: IO error: No such file or directory at org.fusesource.leveldbjni.internal.NativeDB.checkStatus(NativeDB.java:200) at org.fusesource.leveldbjni.internal.NativeDB.open(NativeDB.java:218) at org.fusesource.leveldbjni.JniDBFactory.open(JniDBFactory.java:168) at org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore.serviceInit(LeveldbTimelineStore.java:228) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.serviceInit(ApplicationHistoryServer.java:99) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.launchAppHistoryServer(ApplicationHistoryServer.java:157) The path.getCanonicalPath() in NativeDB.open(NativeOptions options, File path) is converting the path to local file system path and hence the exception. Can anyone help me to check whether we can have the path set to s3 location? Regards, Abhishek --001a11c342bc0391f1051d887f75--