spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From steveloughran <...@git.apache.org>
Subject [GitHub] spark issue #19294: [SPARK-21549][CORE] Respect OutputFormats with no output...
Date Fri, 22 Sep 2017 10:10:46 GMT
Github user steveloughran commented on the issue:

    https://github.com/apache/spark/pull/19294
  
    As I play with commit logic all the way through the stack, I can' t help thinking everyone's
lives would be better if we tagged the MRv1 commit APIs as deprecated in Hadoop 3. and uses
of the commit protocols went fully onto the v2 committers: one codepath to get confused by,
half as much complexity. 
    
    The issue with the custom stuff is inevitably Hive related, isn't it? It's always liked
to scatter data around a filesystem and pretend its a single dataset


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message