kettle清洗hive数据,将数据传到clickhouse中出现以下报错 Error setting value #1 [String(2147483647)

Isay_me 2021-03-10 10:21:04
以下是报错日志:

2021/03/09 17:24:17 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Because of an error, this step can't continue:
2021/03/09 17:24:17 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : org.pentaho.di.core.exception.KettleException:
2021/03/09 17:24:17 - Table output.0 - Error inserting row into table [DIM_SKU_TEST] with values: [10000759]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:385)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run(Unknown Source)
2021/03/09 17:24:17 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2021/03/09 17:24:17 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues(Database.java:1078)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - ... 3 more
2021/03/09 17:24:17 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5128)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue(Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues(Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - ... 4 more
2021/03/09 17:24:17 - Table output.0 - Caused by: java.sql.SQLFeatureNotSupportedException
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream(ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - ... 6 more
2021/03/09 17:24:17 - Table input.0 - Finished reading query, closing connection.
2021/03/09 17:24:17 - Table output.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=1)
2021/03/09 17:24:17 - test1 - Transformation detected one or more steps with errors.
2021/03/09 17:24:17 - test1 - Transformation is killing the other steps!
2021/03/09 17:24:17 - Table input.0 - Finished processing (I=51, O=0, R=0, W=49, U=0, E=0)
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
2021/03/09 17:24:17 - Spoon - The transformation has finished!!
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
...全文
8658 9 打赏 收藏 转发到动态 举报
写回复
用AI写文章
9 条回复
切换为时间正序
请发表友善的回复…
发表回复
weixin_43977393 2023-05-30
  • 打赏
  • 举报
回复

把字段cast( 字段 as varchar(40)) 设置下固定长度,不然默认string非常长,同步就报错了

404Not Foundxxx 2022-06-16
  • 打赏
  • 举报
回复

兄弟 怎么解决的

ZY1819131628 2021-12-16
  • 打赏
  • 举报
回复

更新的字段名中有包含 #,更改个名字

weixin_47404920 2022-07-10
  • 举报
回复
@ZY1819131628 谢谢你,好人侠,问题解决了
wk_wangkang 2023-02-01
  • 举报
回复
@ZY1819131628 我的字段名没有#,也报错了 而且在Dbeaver使用语句进行插入可以。。。。
hylhyl1234 2021-12-12
  • 打赏
  • 举报
回复
我也遇到了这个问题 请问有解决的办法了吗?
mami321 2022-01-25
  • 举报
回复
@hylhyl1234 你最后怎么解决的
  • 打赏
  • 举报
回复

问题解决了嘛,我也遇到了同样的问题

mami321 2021-07-15
  • 举报
回复
@努力成为一名优秀的程序员 你解决了吗?我用kettle也遇到同样问题了

7,388

社区成员

发帖
与我相关
我的任务
社区描述
其他数据库开发 数据仓库
社区管理员
  • 数据仓库
加入社区
  • 近7日
  • 近30日
  • 至今
社区公告
暂无公告

试试用AI创作助手写篇文章吧