hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vamshi Krishna <vamshi2...@gmail.com>
Subject Exception during batch of put problem
Date Tue, 20 Dec 2011 06:26:07 GMT
Hi all, i am trying to copy rows from multiple tables to one table,
selecting rows by some criteria.
i am using batch of puts in to table i.e for every period=100 rows(each row
is of maximum 12 bytes), i am executing
                ...
                ...

                table.setAutoFlush(true);
                table.batch(batch, results);
                table.flushCommits();
                ....

and i have declared before only like ,
          private long period=100,count=0;
         List<Row> batch = new ArrayList<Row>();
         Object[] results = new Object[100];
          and
          Scan s=new Scan();
            s.setCacheBlocks(false);
            s.setCaching(100);
            ....

i am getting following exception..
11/12/20 11:32:48 INFO mapred.JobClient: Running job: job_201112200929_0001
11/12/20 11:32:49 INFO mapred.JobClient:  map 0% reduce 0%
11/12/20 11:33:01 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000000_0, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:04 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000001_0, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:10 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000000_1, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:13 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000001_1, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:16 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000000_2, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:19 INFO mapred.JobClient: Task Id :
attempt_201112200929_0001_m_000001_2, Status : FAILED
java.lang.IllegalArgumentException: argument results must be the same size
as argument list
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1104)
    at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:598)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:56)
    at Setunion.Setunion3$setunionMapper.map(Setunion3.java:1)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)

11/12/20 11:33:25 INFO mapred.JobClient: Job complete: job_201112200929_0001
11/12/20 11:33:25 INFO mapred.JobClient: Counters: 4
11/12/20 11:33:25 INFO mapred.JobClient:   Job Counters
11/12/20 11:33:25 INFO mapred.JobClient:     Rack-local map tasks=4
11/12/20 11:33:25 INFO mapred.JobClient:     Launched map tasks=8
11/12/20 11:33:25 INFO mapred.JobClient:     Data-local map tasks=4
11/12/20 11:33:25 INFO mapred.JobClient:     Failed map tasks=1
hduser@vamshikrishna-desktop:/usr/local/hadoop-0.20.2$


 Actually some thousands of rows have to be inserted to the new table, but
only 200 rows i could see after above  messages thrown on to console.
Please help me why it is happening like this..?  please somebody help..
-- 
*Regards*
*
Vamshi Krishna
*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message