asterixdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Coakley, Kevin" <kcoak...@sdsc.edu>
Subject Re: Trio: AsterixDB, Spark and Zeppelin.
Date Tue, 26 Jul 2016 23:40:39 GMT
Hi Wail,

I am running the contents of https://github.com/Nullification/asterixdb-spark-connector/blob/master/zeppelin-notebook/asterixdb-spark-example/note.json
using spark-shell and I get a 404 error when trying to access /query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1. I don’t know if this is an error with what I am doing, an AsterixDB error or an
error with asterixdb-spark-connector. Thank you for any help that you can provide.

Below is the command that I used and the error (I removed everything else):

/opt/spark/bin/spark-shell --packages org.apache.asterix:asterixdb-spark-connector_2.10:1.6.0
--conf spark.asterix.connection.host=10.128.5.170 --conf spark.asterix.connection.port=19002
--conf spark.asterix.frame.size=131072

…..
scala> val df = sqlContext.aql(aqlQuery,infer = true, printCaseClasses = true)
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.connection.host 10.128.5.170
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.connection.port 19002
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.frame.size 131072
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.frame.number 1
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.reader.number 2
16/07/26 23:27:11 INFO SparkContextFunctions: spark.asterix.prefetch.threshold 2
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request: [route: {}->http://10.128.5.170:19002][total
kept alive: 0; route allocated:
 0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased: [id: 0][route:
{}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection {}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to /10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request POST /aql?mode=asynchronous&schema-inferencer=Spark
HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> POST /aql?mode=asynchronous&schema-inferencer=Spark
HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Content-Length: 386
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Content-Type: text/plain; charset=UTF-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> User-Agent: Apache-HttpClient/4.3.2
(java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 >> Accept-Encoding: gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "POST /aql?mode=asynchronous&schema-inferencer=Spark
HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Content-Length: 386[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Content-Type: text/plain; charset=UTF-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Host: 10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "User-Agent: Apache-HttpClient/4.3.2
(java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "Accept-Encoding: gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "            let $exampleSet := [[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "             {"name" : "Ann", "age"
: 20, "salary" : 100000},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "             {"name" : "Bob", "age"
: 30, "salary" : 200000},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "             {"name" : "Cat", "age"
: 40, "salary" : 300000, "dependents" : [1, 2, 3]},[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "             {"name" : "Cat", "age"
: 50, "salary" : 400000}[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "            ][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "            for $x in $exampleSet[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "            return $x[\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 >> "         "
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Content-Type: application/json;charset=utf-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Transfer-Encoding: chunked[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "Server: Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "11[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "{"handle":[13,0]}[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "0[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-0 << "[\r][\n]"
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << HTTP/1.1 200 OK
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Content-Type: application/json;charset=utf-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Transfer-Encoding: chunked
16/07/26 23:27:11 DEBUG headers: http-outgoing-0 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:11 DEBUG MainClientExec: Connection can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection [id: 0][route: {}->http://10.128.5.170:19002]
can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection released: [id: 0][route:
{}->http://10.128.5.170:19002][total kept alive: 1; route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager is shutting
down
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-0: Close connection
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-0: Close connection
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager shut down
16/07/26 23:27:11 INFO AsterixHttpAPI: Response Handle: {"handle":[13,0]}
16/07/26 23:27:11 INFO AsterixHttpAPI: Handle(JID:13,RSID:0)
16/07/26 23:27:11 DEBUG AsterixHttpAPI: Get status of: %7B%22handle%22%3A%5B13%2C0%5D%7D
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request: [route: {}->http://10.128.5.170:19002][total
kept alive: 0; route allocated:
 0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased: [id: 1][route:
{}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection {}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to /10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request GET /query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> GET /query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> User-Agent: Apache-HttpClient/4.3.2
(java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 >> Accept-Encoding: gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "GET /query/status?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Host: 10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Connection: Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "User-Agent: Apache-HttpClient/4.3.2
(java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "Accept-Encoding: gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 >> "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "HTTP/1.1 200 OK[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Content-Type: text/html;charset=UTF-8[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Content-Length: 20[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "Server: Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-1 << "{"status":"SUCCESS"}"
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << HTTP/1.1 200 OK
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Content-Type: text/html;charset=UTF-8
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Content-Length: 20
16/07/26 23:27:11 DEBUG headers: http-outgoing-1 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:11 DEBUG MainClientExec: Connection can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection [id: 1][route: {}->http://10.128.5.170:19002]
can be kept alive indefinitely
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection released: [id: 1][route:
{}->http://10.128.5.170:19002][total kept alive: 1; route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager is shutting
down
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-1: Close connection
16/07/26 23:27:11 DEBUG DefaultManagedHttpClientConnection: http-outgoing-1: Close connection
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection manager shut down
16/07/26 23:27:11 DEBUG AsterixHttpAPI: Get locations of: %7B%22handle%22%3A%5B13%2C0%5D%7D
16/07/26 23:27:11 DEBUG RequestAddCookies: CookieSpec selected: best-match
16/07/26 23:27:11 DEBUG RequestAuthCache: Auth cache not set in the context
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection request: [route: {}->http://10.128.5.170:19002][total
kept alive: 0; route allocated:
 0 of 2; total allocated: 0 of 20]
16/07/26 23:27:11 DEBUG PoolingHttpClientConnectionManager: Connection leased: [id: 2][route:
{}->http://10.128.5.170:19002][total kept alive: 0; route allo
cated: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:11 DEBUG MainClientExec: Opening connection {}->http://10.128.5.170:19002
16/07/26 23:27:11 DEBUG HttpClientConnectionManager: Connecting to /10.128.5.170:19002
16/07/26 23:27:11 DEBUG MainClientExec: Executing request GET /query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1
16/07/26 23:27:11 DEBUG MainClientExec: Target auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG MainClientExec: Proxy auth state: UNCHALLENGED
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> GET /query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Host: 10.128.5.170:19002
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Connection: Keep-Alive
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> User-Agent: Apache-HttpClient/4.3.2
(java 1.5)
16/07/26 23:27:11 DEBUG headers: http-outgoing-2 >> Accept-Encoding: gzip,deflate
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "GET /query/result/location?handle=%7B%22handle%22%3A%5B13%2C0%5D%7D
HTTP/1.1[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Host: 10.128.5.170:19002[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Connection: Keep-Alive[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "User-Agent: Apache-HttpClient/4.3.2
(java 1.5)[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "Accept-Encoding: gzip,deflate[\r][\n]"
16/07/26 23:27:11 DEBUG wire: http-outgoing-2 >> "[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "HTTP/1.1 404 Not Found[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Cache-Control: must-revalidate,no-cache,no-store[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Content-Type: text/html;charset=ISO-8859-1[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Content-Length: 1288[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "Server: Jetty(8.0.0.RC0)[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "[\r][\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<html>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<head>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<meta http-equiv="Content-Type"
content="text/html;charset=ISO-8859-1"/>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<title>Error 404 Not Found</title>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</head>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<body>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<h2>HTTP ERROR: 404</h2>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<p>Problem accessing /query/result/location.
Reason:[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<pre>    Not Found</pre></p>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "<hr /><i><small>Powered
by Jetty://</small></i>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "                                 
              [\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</body>[\n]"
16/07/26 23:27:12 DEBUG wire: http-outgoing-2 << "</html>[\n]"
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << HTTP/1.1 404 Not Found
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Cache-Control: must-revalidate,no-cache,no-store
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Content-Type: text/html;charset=ISO-8859-1
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Content-Length: 1288
16/07/26 23:27:12 DEBUG headers: http-outgoing-2 << Server: Jetty(8.0.0.RC0)
16/07/26 23:27:12 DEBUG MainClientExec: Connection can be kept alive indefinitely
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection [id: 2][route: {}->http://10.128.5.170:19002]
can be kept alive indefinitely
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection released: [id: 2][route:
{}->http://10.128.5.170:19002][total kept alive: 1; route al
located: 1 of 2; total allocated: 1 of 20]
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection manager is shutting
down
16/07/26 23:27:12 DEBUG DefaultManagedHttpClientConnection: http-outgoing-2: Close connection
16/07/26 23:27:12 DEBUG DefaultManagedHttpClientConnection: http-outgoing-2: Close connection
16/07/26 23:27:12 DEBUG PoolingHttpClientConnectionManager: Connection manager shut down
16/07/26 23:27:12 INFO AsterixHttpAPI: Result Locations: <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Not Found</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /query/result/location. Reason:
<pre>    Not Found</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

net.liftweb.json.JsonParser$ParseException: unknown token <
Near: <h
        at net.liftweb.json.JsonParser$Parser.fail(JsonParser.scala:234)
        at net.liftweb.json.JsonParser$Parser.nextToken(JsonParser.scala:321)
        at net.liftweb.json.JsonParser$$anonfun$2.apply(JsonParser.scala:188)
        at net.liftweb.json.JsonParser$$anonfun$2.apply(JsonParser.scala:141)
        at net.liftweb.json.JsonParser$.parse(JsonParser.scala:80)
        at net.liftweb.json.JsonParser$.parse(JsonParser.scala:45)
        at net.liftweb.json.package$.parse(package.scala:41)
        at net.liftweb.json.Serialization$.read(Serialization.scala:58)
        at org.apache.asterix.connector.AsterixHttpAPI.getResultLocations(AsterixHttpAPI.scala:129)
        at org.apache.asterix.connector.SparkContextFunctions.executeQuery(SparkContextFunctions.scala:103)
        at org.apache.asterix.connector.SparkContextFunctions.aql(SparkContextFunctions.scala:80)
        at org.apache.spark.sql.asterix.SQLContextFunctions.executeQuery(SQLContextFunctions.scala:103)
        at org.apache.spark.sql.asterix.SQLContextFunctions.aql(SQLContextFunctions.scala:84)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:35)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:40)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:42)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:44)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:46)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:48)
        at $iwC$$iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:50)
        at $iwC$$iwC$$iwC$$iwC$$iwC.<init>(<console>:52)
        at $iwC$$iwC$$iwC$$iwC.<init>(<console>:54)
        at $iwC$$iwC$$iwC.<init>(<console>:56)
        at $iwC$$iwC.<init>(<console>:58)
        at $iwC.<init>(<console>:60)
        at <init>(<console>:62)
        at .<init>(<console>:66)
        at .<clinit>(<console>)
        at .<init>(<console>:7)
        at .<clinit>(<console>)
        at $print(<console>)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.repl.SparkIMain$ReadEvalPrint.call(SparkIMain.scala:1065)
        at org.apache.spark.repl.SparkIMain$Request.loadAndRun(SparkIMain.scala:1346)
        at org.apache.spark.repl.SparkIMain.loadAndRunReq$1(SparkIMain.scala:840)
        at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:871)
        at org.apache.spark.repl.SparkIMain.interpret(SparkIMain.scala:819)
        at org.apache.spark.repl.SparkILoop.reallyInterpret$1(SparkILoop.scala:857)
        at org.apache.spark.repl.SparkILoop.interpretStartingWith(SparkILoop.scala:902)
        at org.apache.spark.repl.SparkILoop.command(SparkILoop.scala:814)
        at org.apache.spark.repl.SparkILoop.processLine$1(SparkILoop.scala:657)
        at org.apache.spark.repl.SparkILoop.innerLoop$1(SparkILoop.scala:665)
        at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$loop(SparkILoop.scala:670)
        at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply$mcZ$sp(SparkILoop.scala:997)
        at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945)
        at org.apache.spark.repl.SparkILoop$$anonfun$org$apache$spark$repl$SparkILoop$$process$1.apply(SparkILoop.scala:945)
        at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135)
        at org.apache.spark.repl.SparkILoop.org$apache$spark$repl$SparkILoop$$process(SparkILoop.scala:945)
        at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:1059)
        at org.apache.spark.repl.Main$.main(Main.scala:31)
        at org.apache.spark.repl.Main.main(Main.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)






From: Wail Alkowaileet <wael.y.k@gmail.com>
Reply-To: "users@asterixdb.apache.org" <users@asterixdb.apache.org>
Date: Monday, July 18, 2016 at 5:26 AM
To: "dev@asterixdb.apache.org" <dev@asterixdb.apache.org>, "users@asterixdb.apache.org"
<users@asterixdb.apache.org>
Subject: Re: Trio: AsterixDB, Spark and Zeppelin.

Sorry. Here's the link for the connecot: 
https://github.com/Nullification/asterixdb-spark-connector

On Mon, Jul 18, 2016 at 2:34 PM, Wail Alkowaileet <wael.y.k@gmail.com> wrote:
Dears, 

Finally I finished cleaning and documenting the AsterixDB-Spark connector and finalize Zeppelin
interpreter for AQL and SQL++.

AsterixDB-Spark Connector:
• Supports both AQL and SQL++ queries.
• Much cleaner code now.
• Please if you have ANY problem with it, create an issue in the project repo.
• I'm working on a tutorial-video from the build to use it in Zeppelin.
• I recommend you to use Zeppelin. (you can import the connector example notebook)
Source Code: https://github.com/Nullification/astreixdb-spark-connector

Apache Zeppelin with AsterixDB interpreter:
• Supports JSON-flattening (which will allow zeppelin to visualize results).
• See attached screenshots.
• Will try to initiate pull request to merge it to Zeppelin master.
Source Code: https://github.com/Nullification/zeppelin

Finally, I just submitted Schema Inferencer. I have work on some Sonar comments and it should
be ready soon.

Thanks!

-- 

Regards,
Wail Alkowaileet




-- 

Regards,
Wail Alkowaileet


Mime
View raw message