现象概述
使用可自定义的keyedProcessFunction,本地运行没问题,数据输入输出没问题. 但是上线后出现问题,最终无疾而终,怀疑线上环境导致的.
环境
flink1.18.0(代码 线上 环境版本统一的) python3.9
报错关键词
- Failed to deserialize consumer record due to
- Failed to start remote bundle
- Caused by: org.apache.beam.vendor.grpc.v1p48p1.io.grpc.StatusRuntimeException: CANCELLED: call already cancelled. Use ServerCallStreamObserver.setOnCancelHandler() to disable this exception
- Caught exception while processing timer.
- Caused by: TimerException{java.lang.RuntimeException: Error while waiting for BeamPythonFunctionRunner flush}
- Caused by: java.lang.RuntimeException: Failed to close remote bundle
- Suppressed: java.lang.IllegalStateException: Processing bundle failed, TODO: [https://github.com/apache/beam/issues/18756] abort bundle.
conda 虚拟环境
apache-beam==2.48.0
apache-flink==1.18.0
apache-flink-libraries&#
