spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] wangshisan edited a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file
Date Sat, 21 Sep 2019 12:23:33 GMT
wangshisan edited a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block
locations when listing file
URL: https://github.com/apache/spark/pull/25869#issuecomment-533793656
 
 
   Sorry, I didn't made myself clear.
   Our Spark cluster is deployed separated from HDFS cluster, all the data stored in another
HDFS cluster, and these two clusters share no nodes.
   I mean such deploy mode, separating Spark cluster with the storage cluster(HDFS or some
other distributed file systems), is pretty common. And in such Spark cluster, data locality
is non sense, because it's non reachable.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message