hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gopal Vijayaraghavan <gop...@apache.org>
Subject Re: Anyway to avoid creating subdirectories by "Insert with unionĀ²
Date Thu, 25 Feb 2016 00:26:39 GMT
> SET mapred.input.dir.recursive=TRUE;
...
> Can we set above setting as tblProperties or Hive Table properties.

Not directly, those are MapReduce properties - they are not settable via
Hive tables.

That said, you can write your own SemanticAnalyzerHooks to do pretty much
anything you want like that.

You can use hooks to modify the job, after tables have been resolved.


Ideally such a hook should not modify the plan (much), because it's too
late to do it right.

But I sometimes prototype Hive optimizer features as Hooks, like this one.

https://github.com/t3rmin4t0r/captain-hook


Cheers,
Gopal



Mime
View raw message