Influxdb TSM文件合并压缩失败， Error compacting TSM files

linuxqianrushikaifa 2023-04-20 10:51:19

请教有没有懂时序数据库Influxdb的大神，用的默认存储策略，配置参数基本没修改，运行了几个月之后发现cpu占用率一直高居90%左右，通过调查发现是influxdb在合并压缩TSM文件的时候有一个文件合并失败了，然后一直在重复压缩步骤导致CPU高居不下，看日志发现  warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"} 以为是编码问题，后来发现每次失败都是同时合并10条文件的最后一条出问题，手动把目录中前几条删掉后就能合并成功，又感觉不是编码的问题。有没有大神能解答下为啥会合并失败？？？下面是合并压缩的日志：

2023-04-13T03:03:12.890773Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}
2023-04-13T03:03:12.890837Z    info    Beginning compaction    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_files_n": 10}
2023-04-13T03:03:12.891015Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 0, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000077-000000003.tsm"}
2023-04-13T03:03:12.891041Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 1, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000109-000000003.tsm"}
2023-04-13T03:03:12.891141Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 2, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000146-000000003.tsm"}
2023-04-13T03:03:12.891201Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 3, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000148-000000001.tsm"}
2023-04-13T03:03:12.891271Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 4, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000149-000000001.tsm"}
2023-04-13T03:03:12.891328Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 5, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000150-000000001.tsm"}
2023-04-13T03:03:12.891350Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 6, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000152-000000001.tsm"}
2023-04-13T03:03:12.891475Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 7, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000153-000000001.tsm"}
2023-04-13T03:03:12.891535Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 8, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000155-000000001.tsm"}
2023-04-13T03:03:12.891591Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 9, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm"}
2023-04-13T03:03:21.405776Z    warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"}
2023-04-13T03:03:22.405948Z    info    TSM compaction (end)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "end", "op_elapsed": "9515.174ms"}
2023-04-13T03:03:22.890750Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}
2023-04-13T03:03:22.890801Z    info    Beginning compaction    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_files_n": 10}
2023-04-13T03:03:22.890814Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 0, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000077-000000003.tsm"}
2023-04-13T03:03:22.890826Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 1, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000109-000000003.tsm"}
2023-04-13T03:03:22.890837Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 2, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000146-000000003.tsm"}
2023-04-13T03:03:22.890849Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 3, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000148-000000001.tsm"}
2023-04-13T03:03:22.890859Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 4, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000149-000000001.tsm"}
2023-04-13T03:03:22.890870Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 5, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000150-000000001.tsm"}
2023-04-13T03:03:22.890881Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 6, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000152-000000001.tsm"}
2023-04-13T03:03:22.890893Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 7, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000153-000000001.tsm"}
2023-04-13T03:03:22.890903Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 8, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000155-000000001.tsm"}
2023-04-13T03:03:22.890925Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 9, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm"}
2023-04-13T03:03:31.411709Z    warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"}
2023-04-13T03:03:32.411921Z    info    TSM compaction (end)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "end", "op_elapsed": "9521.166ms"}
2023-04-13T03:03:32.890761Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}

...全文
322 回复 打赏 收藏 转发到动态 举报
写回复
用AI写文章
回复
切换为时间正序
请发表友善的回复…
发表回复
InfluxDBTSM存储引擎之TSMFile
本篇文章主要介绍InfluxDBTSM存储引擎之TSMFile。为了保证时序数据写入的高效，InfluxDB采用LSM结构，数据先写入内存以及WAL，当内存容量达到一定阈值之后flush成文件，文件数超过一定阈值执行合并。这个套路与其他LSM系统（比如HBase）大同小异。不过，InfluxDB在LSM体系架构的基础上针对时序数据做了针对性的存储改进，官方称改进后的存储引擎为TSM（Time-StructuredMergeTree）结构引擎。时序系列文章之时序数据存储模型设计介绍了InfluxDB时间线的概念以及相比其他时序数据库在数据模型设计上的优势，有兴趣的童鞋可以详细阅读上篇文章
influxdb配置官方文档翻译/etc/influxdb/influxdb.conf
配置内容大多根据英文翻译再加上自己的理解而得。阅读配置了解并应证了很多`inflxudb`的运行策略，如： - data的配置，TSM文件存放位置、wal文件存放位置都可以自行修改。 - shard大小可配，默认1g，达到最大值，拒绝写入，shard空闲4个小时后将被压缩。 - cache大小可配，默认25m，到达这个阈值将创建快照输入tsm文件。空闲的cache没有达到25m，也会在10分钟后创建快照刷入tsm文件。 - 数据库最大的series数，默认100万。 - 写超时、最大并发数、查询 超时、慢日志、一次查询的最大point数等。 - 保留策略检查数据过期的时间间隔，默认半小时。
centos influxdb安装
centos influxdb安装 这是我之前整理的InfluxDB安装及配置的笔记，这⾥记录下，也⽅便我以后查阅。 环境： CentOS6.5_x64 InfluxDB版本：1.1.0 ⼀、安装 1、⼆进制安装 这⾥以centos6.5 为例进⾏安装： wget https://dl.influxdata.com/influxdb/releases/influxdb-1.1.0.x86_64.rpm yum localinstall influxdb-1.1.0.x86_64.rpm 其它环境可以参考influxdb官⽅⽂档： 安装后，在/usr/bin 下⾯有如下⽂件： influxd influxdb 服务器 influx influxdb 命令⾏客户端 influx_inspect 查看⼯具 influx_stress 压⼒测试⼯具 influx_tsm 数据库转换⼯具（将数据库从b1或bz1格式转换为tsm1格式） 在/var/lib/influxdb/ 下⾯会有如下⽂件夹：
influxdb-part2.zip
NULL 博文链接：https://lbyzx123.iteye.com/blog/2359387
influxdb tsm文件_Influxdb中TSM文件结构解析之读写TSM
TSM文件组成概述每个TSM文件由4部分组成，源码里给出了文件结构，我们在这里搬过来 Header, Blocks, Index, Footer┌────────┬────────────────────────────────────┬─────────────┬──────────────┐│ Header │ Blocks │ I...
Go+ 开发者社区

1,071

社区成员

213

社区内容

发帖
与我相关
我的任务
社区描述
Go+ 官方开发者社区。我们希望向广大的开发者和数据科学家介绍 Go+ 的定位和意义，并邀请更多开发者一起贡献代码、共建 Go+ 生态。 Go+ 官网：https://goplus.org/
其他 企业社区
社区管理员
  • Go+
  • 杨东杰
加入社区
  • 近7日
  • 近30日
  • 至今

加载中

查看更多榜单
社区公告

本社区为 Go+ 官方开发者社区。我们希望向广大的开发者和数据科学家介绍 Go+ 的定位和意义，并邀请更多开发者一起贡献代码、共建 Go+ 生态。

Go+ 官网：https://goplus.org/
GitHub地址：https://github.com/goplus/gop

试试用AI创作助手写篇文章吧

+ 用AI写文章