spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <>
Subject [GitHub] [spark] juliuszsompolski commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message
Date Wed, 01 Jul 2020 12:14:59 GMT

juliuszsompolski commented on pull request #28963:

   @LantaoJin changed it the other way around in,
to display the actual error in AQE, I think there are more cases where the more useful internal
error gets obscured - e.g. when a task fails, you would get actual reason for failure from
the root cause, as opposed to just a "Task failed 4 times" RuntimeException.
   We've been recently investigating another issue, where "SparkUpgradeException" would not
be displayed by thriftserver, because it was going for the root cause.
   Maybe we should do it in general, but then whitelist a few cases that should go for the
   - AQE exception
   - Job/stage failed
   - ...

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message