往HBase中批量插入数据,间歇性的会出现插入速度极慢的现象

mylife512 2018-06-27 07:47:31
[27/06/18 06:34:29:029 CST] Thread-17 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 494 ms.
[27/06/18 06:34:29:029 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 528 ms.
[27/06/18 06:34:29:029 CST] Thread-8 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 485 ms.
[27/06/18 06:34:30:030 CST] main-SendThread(host-1:2181) DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x3642eec647c2669 after 5ms
[27/06/18 06:34:30:030 CST] main-SendThread(host-2:2181) DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x164251401663bb7 after 0ms
[27/06/18 06:34:30:030 CST] Thread-11 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 511 ms.
[27/06/18 06:34:30:030 CST] Thread-17 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 500 ms.
[27/06/18 06:34:30:030 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 507 ms.
[27/06/18 06:34:30:030 CST] Thread-8 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 467 ms.
[27/06/18 06:34:31:031 CST] Thread-11 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 530 ms.
[27/06/18 06:34:31:031 CST] Thread-17 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 531 ms.
[27/06/18 06:34:31:031 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 550 ms.
[27/06/18 06:34:31:031 CST] Thread-8 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 509 ms.
[27/06/18 06:34:31:031 CST] main-SendThread(host-1:2181) DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x164251401663bb8 after 0ms
[27/06/18 06:34:32:032 CST] main-SendThread(host-2:2181) DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x3642eec647c266a after 3ms
[27/06/18 06:34:33:033 CST] Thread-11 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 1375 ms.
[27/06/18 06:34:33:033 CST] Thread-8 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 1345 ms.
[27/06/18 06:34:33:033 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 1376 ms.
[27/06/18 06:34:44:044 CST] Thread-17 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 12919 ms.
[27/06/18 06:34:44:044 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 11312 ms.
[27/06/18 06:34:44:044 CST] Thread-11 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 11315 ms.
[27/06/18 06:34:44:044 CST] Thread-8 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 11263 ms.
[27/06/18 06:34:45:045 CST] Thread-7 INFO hbase.HBaseSink: Batch Size: 10000, table tb_access_log commited and flushed cost 601 ms.

开了四个线程往HBase中批量插入数据,间歇性的会出现插入速度极慢的现象,
各位大佬帮忙解答一下
...全文
161 回复 打赏 收藏 转发到动态 举报
写回复
用AI写文章
回复
切换为时间正序
请发表友善的回复…
发表回复

248

社区成员

发帖
与我相关
我的任务
社区描述
其他产品/厂家
社区管理员
  • 其他
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧