Influxdb TSM文件合并压缩失败， Error compacting TSM files

2023-04-20 10:51:19 1k 阅读 AI 写同款 · GEO 优化AI 选题数据监测一键分发 ›
linuxqianrushikaifa linuxqianrushikaifa 墨衍会员 · AI 创作全网分发 墨衍智能分发 通过墨衍一键同步至各平台 可同步平台 CSDN微信公众号微博知乎掘金百家号博客园抖音小红书 你的文章也可以这样分发 墨衍会员 ¥399起/年，写一次发全网 我也要 + 加入社区
CentOS 7 + InfluxDB + collectd 构建轻量级系统指标监控体系 时间序列数据库是存储和分析带时间戳的数值型监控数据（如CPU、内存、磁盘IO）的核心基础设施。InfluxDB凭借专为时序优化的TSM引擎、高压缩率与原生降采样能力，显著优于MySQL或Elasticsearch等通用数据库在system metrics场景下的表现；结合资源占用极低、内核兼容性久经验证的collectd，在CentOS 7 minimal环境下可实现稳定高效的指标采集。该组合无需容器编排或云服务依赖，适用于物理机、VMware虚拟机及边缘服务器等受限环境，广泛应用于运维可观测性建设、性能压 阅读详情

请教有没有懂时序数据库Influxdb的大神，用的默认存储策略，配置参数基本没修改，运行了几个月之后发现cpu占用率一直高居90%左右，通过调查发现是influxdb在合并压缩TSM文件的时候有一个文件合并失败了，然后一直在重复压缩步骤导致CPU高居不下，看日志发现  warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"} 以为是编码问题，后来发现每次失败都是同时合并10条文件的最后一条出问题，手动把目录中前几条删掉后就能合并成功，又感觉不是编码的问题。有没有大神能解答下为啥会合并失败？？？下面是合并压缩的日志：

2023-04-13T03:03:12.890773Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}
2023-04-13T03:03:12.890837Z    info    Beginning compaction    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_files_n": 10}
2023-04-13T03:03:12.891015Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 0, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000077-000000003.tsm"}
2023-04-13T03:03:12.891041Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 1, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000109-000000003.tsm"}
2023-04-13T03:03:12.891141Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 2, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000146-000000003.tsm"}
2023-04-13T03:03:12.891201Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 3, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000148-000000001.tsm"}
2023-04-13T03:03:12.891271Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 4, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000149-000000001.tsm"}
2023-04-13T03:03:12.891328Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 5, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000150-000000001.tsm"}
2023-04-13T03:03:12.891350Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 6, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000152-000000001.tsm"}
2023-04-13T03:03:12.891475Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 7, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000153-000000001.tsm"}
2023-04-13T03:03:12.891535Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 8, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000155-000000001.tsm"}
2023-04-13T03:03:12.891591Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 9, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm"}
2023-04-13T03:03:21.405776Z    warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"}
2023-04-13T03:03:22.405948Z    info    TSM compaction (end)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "end", "op_elapsed": "9515.174ms"}
2023-04-13T03:03:22.890750Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}
2023-04-13T03:03:22.890801Z    info    Beginning compaction    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_files_n": 10}
2023-04-13T03:03:22.890814Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 0, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000077-000000003.tsm"}
2023-04-13T03:03:22.890826Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 1, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000109-000000003.tsm"}
2023-04-13T03:03:22.890837Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 2, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000146-000000003.tsm"}
2023-04-13T03:03:22.890849Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 3, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000148-000000001.tsm"}
2023-04-13T03:03:22.890859Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 4, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000149-000000001.tsm"}
2023-04-13T03:03:22.890870Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 5, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000150-000000001.tsm"}
2023-04-13T03:03:22.890881Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 6, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000152-000000001.tsm"}
2023-04-13T03:03:22.890893Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 7, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000153-000000001.tsm"}
2023-04-13T03:03:22.890903Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 8, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000155-000000001.tsm"}
2023-04-13T03:03:22.890925Z    info    Compacting file    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "tsm1_index": 9, "tsm1_file": "hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm"}
2023-04-13T03:03:31.411709Z    warn    Error compacting TSM files    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "error": "block read error on hisdb/engine/data/65b1b1f12e9b83f5/autogen/26/000000157-000000001.tsm: decode error: unable to decompress block type float for key 'yx,k=40#!~#t': EOF"}
2023-04-13T03:03:32.411921Z    info    TSM compaction (end)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "end", "op_elapsed": "9521.166ms"}
2023-04-13T03:03:32.890761Z    info    TSM compaction (start)    {"log_id": "0hA8vBM0000", "service": "storage-engine", "engine": "tsm1", "tsm1_strategy": "full", "tsm1_optimize": false, "op_name": "tsm1_compact_group", "op_event": "start"}

...全文
nRF52382低功耗蓝牙应用开发之入门教程-软件烧录 准备工作在上一篇文章讲过了，这里就讲讲nRFgo studio的使用 硬件准备： J-link：2线 供电：3.3V 如下图打开nRFgo studio界面介绍， 2、如果J-link正常，如下图 3、如果蓝牙芯片正常 4、烧录过程，如果蓝牙芯片之前有烧录过程序，需先点擦除，再点烧录 5、烧录代码路劲，例如 F:\nRF\SDK\nRF5_SDK_15.2.0_... 阅读详情

相关推荐

基于恒阻抗负荷模型与母线三相短路扰动条件下三机九节点系统多频段电力系统稳定器暂态稳定性能评估（Simulink仿真实现）

内容概要：本文系统阐述了一套基于优先级规划与Petri网融合的多机器人路径规划（MAPF）MATLAB代码库，该框架将求解过程划分为几何解析、拓扑构建、调度优化与可视化呈现四个层次，实现了从地图解析、四邻域拓扑与Petri网建模，到基于优先级启发式的路径搜索、时间同步与冲突消解，再到动画与视频输出的完整闭环。其核心创新在于采用Petri网将“多机器人无冲突”这一动态时间约束转化为“每库所至多一标记”的静态容量约束，从而支持整数规划求解；并通过动态边权膨胀机制避免因硬封锁导致的虚假不可解问题，结合节点预留历史与几何惩罚驱动的局部同步策略，显著提升了冲突查询效率与调度性能。框架还支持双坐标系统与全流程可视化，便于算法行为分析与结果验证。; 适合人群：具备一定编程基础和机器人路径规划基础知识的研究生、科研人员及工程技术人员，尤其适合从事仓储物流、自动驾驶、无人机编队等多智能体系统研究的专业人士。; 使用场景及目标：① 在大规模多机器人系统中快速生成无冲突路径，适用于自动化仓库调度等工业场景；② 作为教学与研究工具，深入理解MAPF中的优先级规划、Petri网建模、冲突消解机制及其数学本质；③ 支持算法复现与扩展，可用于对比不同启发式策略、同步算法与规划框架的性能差异。; 阅读建议：建议读者按照文中组织结构顺序阅读，重点关注各模块之间的接口设计与信息传递机制，结合提供的代码实例进行调试与运行，深入理解动态边权膨胀、Petri网容量约束转化、节点预留历史与几何惩罚驱动同步等关键技术的设计意图与实现细节。

欢多天天写代码

机械三维3D设计图-打铁扣自动机.zip

机械三维3D设计图-打铁扣自动机.zip

ZL4120505

机械三维3D设计图-光伏铝板自动打标码垛线step.zip

机械三维3D设计图-光伏铝板自动打标码垛线step.zip

ZL4120505

译页：一款支持大模型翻译的浏览器网页翻译插件

机器翻译及大模型翻译，需要到浏览器扩展中心开启开发者后加载未打包扩展程序

qq_34894365

日式式样书最新版本no.4模版免费模版

日式式样书最新版本no.4模版版免费模版

chenrlong
评论
收藏 已收藏
分享
返回顶部
linuxqianrushikaifa
linuxqianrushikaifa
Go+ 开发者社区 1,099 成员 209 内容
+ 加入社区