crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mārtiņš Kalvāns <martins.kalv...@gmail.com>
Subject .materialize() returns empty collection on pipeline error?
Date Wed, 28 Jan 2015 17:26:25 GMT
Hi.

When pipeline fails on cluster with some exception, materialize() returns
empty collection and just logs error message.

I'm (very, very) puzzled about this behaviour:
https://github.com/apache/crunch/blob/master/crunch-core/src/main/java/org/apache/crunch/materialize/MaterializableIterable.java#L92
Is this really intended behaviour?

If so, then some documentation for materialize() function about this
behaviour would be really nice to have. :)


--
Mārtiņš

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message