kettle清洗hive数据,将数据传到clickhouse中出现以下报错 Error setting value #1 [String(2147483647)

Isay_me 2021-03-10 10:21:04
以下是报错日志:

2021/03/09 17:24:17 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Because of an error, this step can't continue:
2021/03/09 17:24:17 - Table output.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : org.pentaho.di.core.exception.KettleException:
2021/03/09 17:24:17 - Table output.0 - Error inserting row into table [DIM_SKU_TEST] with values: [10000759]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:385)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run(Unknown Source)
2021/03/09 17:24:17 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2021/03/09 17:24:17 - Table output.0 - offending row : [SKU_SK String(2147483647)]
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues(Database.java:1078)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - ... 3 more
2021/03/09 17:24:17 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2021/03/09 17:24:17 - Table output.0 - Error setting value #1 [String(2147483647)] on prepared statement
2021/03/09 17:24:17 - Table output.0 - at java.lang.Thread.run (null:-1)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow (TableOutput.java:125)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable (TableOutput.java:261)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues (Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue (Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue (ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream (ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 -
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5128)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValue(Database.java:1060)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.database.Database.setValues(Database.java:1076)
2021/03/09 17:24:17 - Table output.0 - ... 4 more
2021/03/09 17:24:17 - Table output.0 - Caused by: java.sql.SQLFeatureNotSupportedException
2021/03/09 17:24:17 - Table output.0 - at ru.yandex.clickhouse.ClickHousePreparedStatementImpl.setCharacterStream(ClickHousePreparedStatementImpl.java:416)
2021/03/09 17:24:17 - Table output.0 - at org.pentaho.di.core.row.value.ValueMetaBase.setPreparedStatementValue(ValueMetaBase.java:5042)
2021/03/09 17:24:17 - Table output.0 - ... 6 more
2021/03/09 17:24:17 - Table input.0 - Finished reading query, closing connection.
2021/03/09 17:24:17 - Table output.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=1)
2021/03/09 17:24:17 - test1 - Transformation detected one or more steps with errors.
2021/03/09 17:24:17 - test1 - Transformation is killing the other steps!
2021/03/09 17:24:17 - Table input.0 - Finished processing (I=51, O=0, R=0, W=49, U=0, E=0)
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
2021/03/09 17:24:17 - Spoon - The transformation has finished!!
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
2021/03/09 17:24:17 - test1 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Errors detected!
...全文
5058 6 打赏 收藏 举报
写回复
6 条回复
切换为时间正序
请发表友善的回复…
发表回复

兄弟 怎么解决的

  • 打赏
  • 举报
回复
ZY1819131628 2021-12-16

更新的字段名中有包含 #,更改个名字

  • 打赏
  • 举报
回复
hylhyl1234 2021-12-12
我也遇到了这个问题 请问有解决的办法了吗?
  • 打赏
  • 举报
回复
mami321 01-25
@hylhyl1234 你最后怎么解决的
  • 举报
回复

问题解决了嘛,我也遇到了同样的问题

  • 打赏
  • 举报
回复
mami321 2021-07-15
@努力成为一名优秀的程序员 你解决了吗?我用kettle也遇到同样问题了
  • 举报
回复
发帖
数据仓库
加入

7371

社区成员

其他数据库开发 数据仓库
社区管理员
  • 数据仓库
申请成为版主
帖子事件
创建了帖子
2021-03-10 10:21
社区公告
暂无公告