Mailing-List: contact drill-user-help@incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: drill-user@incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of varadham@thoughtworks.com
 designates 64.18.0.147 as permitted sender)
MIME-Version: 1.0
From: Varadharajan M <varadham@thoughtworks.com>
Date: Sat, 19 Oct 2013 23:36:57 +0530
Message-ID: 
 <CA+RN-7EOsmkm8VLL=X3ATx-ugQsGQqaK6J-TOdpkFWyLHsUPVg@mail.gmail.com>
Subject: Usage of 'store' operation in Logical Queries
To: drill-user@incubator.apache.org
Content-Type: multipart/alternative; boundary=047d7ba97f3ae2c48d04e91beb8f

--047d7ba97f3ae2c48d04e91beb8f
Content-Type: text/plain; charset=ISO-8859-1

Hi All,

I've a logical plan, thats intended to read from a json file and write the
output to another file. I was under the impression that the write operation
could be done with the help of 'store' operation. Here is my logical plan:

{
  "head" : {
    "type" : "APACHE_DRILL_LOGICAL",
    "version" : "1",
    "generator" : {
    "type" : "optiq",
    "info" : "na"
    }
  },

  "storage" : {
    "jsonl" : {
      "type" : "json",
      "dfsName" : "file:///"
    },
    "filel" : {
      "type" : "fs",
      "root" : "file:///"
    }
  },

  "query" : [ {
    "op" : "scan",
    "memo" : "initial_scan",
    "ref" : "_MAP",
    "storageengine" : "jsonl",
    "selection" : [ {
      "path" : "/tmp/students.json"
    } ],
    "@id" : 1
  },

  {
    "op" : "store",
    "input" : 1,
    "memo" : "output sink",
    "storageengine": "filel",
    "@id" : 2,
     target: {
        file: "file:///tmp/do.json"
      }
  } ]
}


Now, if i try to run this logical plan with the submit_plan shell script, i
get the output to the console rather than to the specified file (That is,
there is no data written to the file). Am i missing anything here?

- Varadha

--047d7ba97f3ae2c48d04e91beb8f--