记录一个flink跑kafka connector遇到的问题

【报错】

D:\Java\jdk1.8.0_231\bin\java.exe "-javaagent:D:\Program Files\JetBrains\IntelliJ IDEA 2022.2.3\lib\idea_rt.jar=56647:D:\Program Files\JetBrains\IntelliJ IDEA 2022.2.3\bin" -Dfile.encoding=UTF-8 -classpath D:\Java\jdk1.8.0_231\jre\lib\charsets.jar;D:\Java\jdk1.8.0_231\jre\lib\deploy.jar;D:\Java\
Exception in thread "main" java.lang.RuntimeException: Failed to fetch next result
Caused by: java.util.concurrent.ExecutionException: 
Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
Caused by: java.io.IOException: Failed to deserialize consumer record due to
Caused by: java.io.IOException: Failed to deserialize consumer record ConsumerRecord(topic 
Caused by: java.lang.RuntimeException: Row length mismatch. 3 fields expected but was 2.


进程已结束,退出代码1

Job execution failed.

Recovery is suppressed by NoRestartBackoffTimeStrategy

Failed to deserialize consumer record due to

Failed to deserialize consumer record ConsumerRecord(topic = topicA, partition = 1, leaderEpoch = 2, offset = 4, CreateTime = 1718247641082, serialized key size = -1, serialized value size = 7, headers = RecordHeaders(headers = [], isReadOnly = false), key = null, value = [B@3ecd79e3).

Failed to deserialize CSV row '1,dahua'.

Row length mismatch. 3 fields expected but was 2.

上面這幾個是bug中我找的关于问题的关键点

【解决】

将报错粘到网上,说是我分区数据坏了,kafka解析不了,所以把对应的这个topicA删除,重建一次,再往里写数据就好了

删除对应主题: bin/kafka-topics.sh --bootstrap-server hadoop102:9092 --delete --topic

重建对应主题:bin/kaftopics.sh --bootstrap-server hadoop102:9092 --create --partitions 1 --replication-factor 2 --topic topicA

启个对应主题的生产者:bin/kafka-consolroducer.sh --bootstrap-server hadoop102:9092 --topic topicA

往里写数据(先保证对应的这个java程序你已经启动了)

相关推荐

  1. 记录启动Dubbo-admin遇到问题

    2024-06-16 21:26:04       57 阅读
  2. vue启动遇到问题记录

    2024-06-16 21:26:04       42 阅读

最近更新

  1. docker php8.1+nginx base 镜像 dockerfile 配置

    2024-06-16 21:26:04       98 阅读
  2. Could not load dynamic library ‘cudart64_100.dll‘

    2024-06-16 21:26:04       106 阅读
  3. 在Django里面运行非项目文件

    2024-06-16 21:26:04       87 阅读
  4. Python语言-面向对象

    2024-06-16 21:26:04       96 阅读

热门阅读

  1. 高效时间管理

    2024-06-16 21:26:04       34 阅读
  2. Leetcode 3. 无重复字符的最长子串

    2024-06-16 21:26:04       39 阅读
  3. C# —— while循环语句

    2024-06-16 21:26:04       32 阅读
  4. c++ 笔记二

    2024-06-16 21:26:04       32 阅读
  5. 什么是贸易顺差和贸易逆差?

    2024-06-16 21:26:04       24 阅读
  6. 通货膨胀和通货紧缩是什么?

    2024-06-16 21:26:04       31 阅读
  7. 软件服务中的 SLA 到底是什么?

    2024-06-16 21:26:04       29 阅读
  8. 一步一步写线程之十五协程

    2024-06-16 21:26:04       28 阅读
  9. 【Flask 系统教程 7】数据库使用 SQLAlchemy

    2024-06-16 21:26:04       25 阅读
  10. Dubbo源码解析-mock原理

    2024-06-16 21:26:04       30 阅读