crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinal Shah <>
Subject Illegal State Exception when doing a union
Date Tue, 25 Feb 2014 23:04:52 GMT

I'm trying to do an union of 3 PTables but I'm getting this error

this is where it is throwing it

this is what I'm trying to do

PCollection<U> beforeWrite = someOperation();

SourceTarget<U> target = new AvroFileTarget().asSourceTaget(U);

pipeline.write(beforeWrite, target);

PCollection<U> afterWrite =;

PCollection<U> afterParallelDo = afterWrite.parallelDo(DoFn, U,

PTable<K,U> afterSomeOperation = someOperations();

PTable<K,U> thatNeedsToBeAdded = comingFromHbase();

PTable<K,U> unionNeeded =  afterSomeOperation.union(thatNeedsToBeAdded); //
this is where it fails for some reason since it is looking for the target
which is not generated yet.

Can anyone help me in understanding why this is happening?


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message