为什么在Flume中加入自定义interceptor会报出ClassNotFoundException

sinat_36117757 sinat_36117757 墨衍会员 · AI 创作全网分发 墨衍智能分发 通过墨衍一键同步至各平台 可同步平台 CSDN微信公众号微博知乎掘金百家号博客园抖音小红书 你的文章也可以这样分发 墨衍会员 ¥399起/年,写一次发全网 我也要 + 加入社区
RT,我想在Flume中加入一个自定义的拦截器,可是遇到了问题
下面是我flume的配置文件:
agent.sources=s1
agent.channels=c1
agent.sinks=k1

agent.sources.s1.type=syslogtcp
agent.sources.s1.host=192.168.1.37
agent.sources.s1.port=i20000
agent.sources.s1.channels=c1
agent.sources.s1.interceptors =i1
agent.sources.s1.interceptors.i1.type=com.flume.interceptor.HbInterceptor$Builder

agent.sinks.k1.type=file_roll
agent.sinks.k1.sink.directory=/soft/flume/file_sink
agent.sinks.k1.sink.serializer=text
agent.sinks.k1.channel=c1

agent.channels.c1.type=memory
agent.channels.c1.capacity=1000
agent.channels.c1.transactionCapacity=500
下面代码是我自定义的拦截器类:
package com.flume.interceptor;

import java.util.ArrayList;
import java.util.Arrays;
import java.util.List;

import org.apache.flume.Context;
import org.apache.flume.Event;
import org.apache.flume.interceptor.Interceptor;

public class HbInterceptor implements Interceptor {

HbInterceptor(){

}

public void close() {

}

public void initialize() {

}

public Event intercept(Event event) {
try {
byte[] body = event.getBody();
byte[] frame = Arrays.copyOfRange(body, 0, 2);
if (frame[0] == '#' && frame[1] == '#') {
byte[] dataLen = Arrays. copyOfRange(body, frame.length,
frame.length + 4);
String dataLenStr = String.valueOf(dataLen);
int dataLength = Integer.parseInt(dataLenStr);
byte[] data = Arrays.copyOfRange(body, frame.length
+ dataLen.length, frame.length + dataLen.length
+ dataLength);
byte[] crcCheck = Arrays.copyOfRange(body, frame.length
+ dataLen.length + dataLength, frame.length
+ dataLen.length + dataLength + 4);
int dataCRC = ByteStrToInt(crcCheck);
int CrcSum = checkOutSixteenCheckSum(data, dataLength);
if (dataCRC == CrcSum) {
event.setBody(data);
} else {
event = null;
}
} else {
event = null;
}
} catch (Exception e) {
e.printStackTrace();
}

return event;
}

public List<Event> intercept(List<Event> events) {
List<Event> intercepted = new ArrayList<Event>();
for (Event event : events) {
Event interceptorEvent = intercept(event);
if (interceptorEvent != null) {
intercepted.add(interceptorEvent);
}
}
return intercepted;
}

public static class Builer implements Interceptor.Builder{

public void configure(Context context) {

}

public Interceptor build() {
return new HbInterceptor();
}

}

// \u5c06\u7ec8\u7aef\u8ba1\u7b97\u7684CRC\u8ba1\u7b97\u503c\u8f6c\u5316\u6210int\u578b
public int ByteStrToInt(byte[] checkSum) {
String str = new String(checkSum);
int iValule = Integer.parseInt(str, 16);
return iValule;
}

// 212\u534f\u8bae\u7684CRC\u6821\u9a8c\u7b97\u6cd5
private int checkOutSixteenCheckSum(byte[] bytes, int len) {
int r = 0xffff;
char hi;
char flag;
for (int i = 0; i < len; i++) {
hi = (char) (r >> 8);
hi ^= bytes[i];
r = hi;

for (int j = 0; j < 8; j++) {
flag = (char) (r & 0x0001);
r = r >> 1;
if (flag == 1) {
r ^= 0xa001;
}
}
}
return r;
}
}
我将上面的工程打成jar包放到了flume根目录中lib文件夹中,然后用上面的配置文件运行会报出java.lang.ClassNotFoundException: com.flume.interceptor.HbInterceptor$Builder
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:190)
at org.apache.flume.interceptor.InterceptorBuilderFactory.newInstance(InterceptorBuilderFactory.java:48)
at org.apache.flume.channel.ChannelProcessor.configureInterceptors(ChannelProcessor.java:111)
at org.apache.flume.channel.ChannelProcessor.configure(ChannelProcessor.java:82)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:348)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:101)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:141)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-03-13 11:26:20,128 (conf-file-poller-0) [ERROR - org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:361)] Source s1 has been removed due to an error during configuration
org.apache.flume.FlumeException: Interceptor.Builder not found.
at org.apache.flume.channel.ChannelProcessor.configureInterceptors(ChannelProcessor.java:116)
at org.apache.flume.channel.ChannelProcessor.configure(ChannelProcessor.java:82)
at org.apache.flume.conf.Configurables.configure(Configurables.java:41)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:348)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:101)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:141)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: com.flume.interceptor.HbInterceptor$Builder
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:190)
at org.apache.flume.interceptor.InterceptorBuilderFactory.newInstance(InterceptorBuilderFactory.java:48)
at org.apache.flume.channel.ChannelProcessor.configureInterceptors(ChannelProcessor.java:111)
... 12 more
刚开始就接触Flume,求大神给指出哪里出问题了,谢谢!
...全文

相关推荐

java.lang.ClassNotFoundException: org.intropro.flume.HtmlInterceptor$Buider

Flume自定义拦截器,然后运行job任务出现 `02/08/23 09:13:25 ERROR channel.ChannelProcessor: Builder class not found. Exception follows. java.lang.ClassNotFoundException: org.intropro.flume.HtmlInterceptor$Buider`

海洋 之心

2026安卓开发从零实战指南:环境搭建、核心基础与避坑干货(适配新版Android_Studio).pdf

2026安卓开发从零实战指南:环境搭建、核心基础与避坑干货(适配新版Android_Studio).pdf

彼岸交流群

如何实现科研成果转化率的有效提升与技术市场精准对接?.docx

如何实现科研成果转化率的有效提升与技术市场精准对接?

BIZKEEN

基于PID控制的ABS汽车防抱死制动系统、车轮滑移率+最优滑移率Carsim和Simulink联合仿真(带参考文献)

内容概要:本文档系统研究了基于PID控制的ABS汽车防抱死制动系统,聚焦于车轮滑移率与最优滑移率的动态控制问题,采用Carsim与Simulink联合仿真平台构建高精度车辆动力学模型与控制系统。研究详细阐述了ABS的工作机理,通过设计PID控制器实时调节制动压力,确保车轮滑移率稳定在最优区间,从而最大化轮胎与路面间的摩擦力,提升制动效能与行车安全性。文档涵盖了完整的建模流程、控制策略设计、仿真验证方法及参数整定过程,并提供了详实的参考文献支持,增强了研究的可复现性与工程应用价值。; 适合人群:具备车辆工程、自动化或控制理论等相关专业背景,熟悉MATLAB/Simulink与Carsim仿真环境的研究生、科研人员及汽车行业技术研发工程师。; 使用场景及目标:①用于ABS控制算法的教学讲解与科研实验;②支撑车辆制动性能优化、主动安全系统开发等实际工程应用;③为相关学术论文撰写、课题复现与技术创新提供理论依据与技术参考。; 阅读建议:建议读者结合所提供的仿真模型与参考文献,逐步运行并调试代码,重点关注滑移率计算逻辑、PID参数整定方法及联合仿真的数据交互机制,同时可尝试引入模糊控制、自适应控制等先进算法进行对比分析,以深入掌握ABS系统的控制精髓与优化路径。

荔枝科研社

高校如何利用技术转移数据分析优化成果转化路径?.docx

科易网基于40亿+科创知识图谱数据库,深度探索AI技术在技术转移、成果转化、技术经纪、知识产权、产业创新、科技招商等垂直领域的多样化应用场景,研究科技创新领域的AI+数智化解决方案,推动科技创新与产业创新智能化发展。

BIZKEEN
评论 1
收藏 已收藏
分享
返回顶部
sinat_36117757
云存储 932 成员 651 内容