hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gautham Acharya <gauth...@alleninstitute.org>
Subject RE: Import TSV - too many args/columns
Date Wed, 16 Oct 2019 18:27:07 GMT
Searched, didn't find any results.

Hacking ImportTSV isn't really an option, as we're using a managed Hbase instance on AWS EMR.

-----Original Message-----
From: Stack [mailto:stack@duboce.net] 
Sent: Wednesday, October 16, 2019 11:25 AM
To: Hbase-User <user@hbase.apache.org>
Subject: Re: Import TSV - too many args/columns

CAUTION: This email originated from outside the Allen Institute. Please do not click links
or open attachments unless you've validated the sender and know the content is safe.

You've tried search net for how others deal with arg list too long? You might have to hack
on the importtsv script?

On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya <gauthama@alleninstitute.org>

> I'm trying to use the ImportTSV utility to generate HFiles and move 
> them into an instance using the CompleteBulkLoad tool.
> Right now an error I'm running into is that the arg list is too long -  
> I have over 50,000 columns to specify in my CS, and the bash shell 
> throws an error. Is there an easy way around this? Piping the 
> arguments does not seem to work either.
> --gautham
View raw message