hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Damien Hardy <dha...@viadeoteam.com>
Subject HBase export limit bandwith
Date Wed, 04 Jun 2014 12:39:58 GMT
Hello,

We are trying to export HBase table on S3 for backup purpose.
By default export tool run a map per region and we want to limit output
bandwidth on internet (to amazon s3).

We were thinking in adding some reducer to limit the number of writers
but this is explicitly hardcoded to 0 in Export class
```
    // No reducers. Just write straight to output files.
    job.setNumReduceTasks(0);
```

Is there an other way (propertie?) in hadoop to limit output bandwidth ?

-- 
Damien


Mime
View raw message