clickhouse自动合并任务使用内存过大，能通过参数限制吗

2025-05-26 11:26:34 634 阅读 AI 写同款 · GEO 优化AI 选题数据监测一键分发 ›

laijunlin_data 墨衍会员 · AI 创作全网分发关注 + 加入社区

clickhouse 报内存不足的问题文章目录概述解决办法概述在使用ck清洗数据的时候报内存不足： Progress: 1.83 billion rows, 85.31 GB (68.80 million rows/s., 3.21 GB/s.) 6%Received exception from server: Code: 241. DB::Exception: Received from localhost:9000, 127.0.0.1. DB::Exception: Memory limit (for query) 阅读详情

#遇到问题的现象描述
clickhouse（22.3.7.28）自动合并任务使用内存过大，能通过参数限制吗？
#问题相关情况
表引擎使用的是ReplicatedMergeTree

{
"SELECT \r\n    database,\r\n    table,\r\n        memory_usage,\r\n         memory_usage \/ 1073741824 AS memory_usage_gib, -- 转换为 GiB\r\n    elapsed,\r\n    progress,\r\n    num_parts,\r\n    result_part_name,\r\n    is_mutation,\r\n    total_size_bytes_compressed,\r\n    total_size_marks,\r\n    bytes_read_uncompressed,\r\n    rows_read,\r\n    bytes_written_uncompressed,\r\n    rows_written,\r\n    thread_id,\r\n    merge_type,\r\n    merge_algorithm\r\nFROM system.merges": [
	{
		"database" : "traceablity",
		"table" : "ck_traceability_info",
		"memory_usage" : 17206055010,
		"memory_usage_gib" : 11.6024387450888753,
		"elapsed" : 481.386892202,
		"progress" : 0.4034078198535675,
		"num_parts" : 9,
		"result_part_name" : "2025_2663098_2837828_333",
		"is_mutation" : 0,
		"total_size_bytes_compressed" : 31103940946,
		"total_size_marks" : 13675,
		"bytes_read_uncompressed" : 68023543442,
		"rows_read" : 27105999,
		"bytes_written_uncompressed" : 78651449792,
		"rows_written" : 27105999,
		"thread_id" : 41153,
		"merge_type" : "REGULAR",
		"merge_algorithm" : "Vertical"
	}
]}

#解答思路
能否通过设置clickhouse的相关参数进行合并操作的内存限制。

...全文