hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matteo Bertozzi <theo.berto...@gmail.com>
Subject Re: Regd: ExportSnapshot Tool (export Hfiles in parts)
Date Fri, 05 Feb 2016 03:00:17 GMT
the multipart upload is on the s3 connector.
you can tune your connector, to use multipart
fs.s3n.multipart.uploads.enabled = true

Matteo


On Thu, Feb 4, 2016 at 6:34 PM, Vishnu Amdiyala <vishnuamdiyala@gmail.com>
wrote:

> Hi,
>
> I am trying to back up snapshots of Hbase table to S3 bucket of which each
> Hfile is sized>5GB which fails due to S3 bucket's 5gb limitation.  The
> export snapshot's source says that the mappers are set to max of  total
> number of files. Is there a way to use this tool to split files and upload
> to S3 in parts?
>
>
> Thanks!
> Vishnu
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message