pyflink 读取excel

import argparse
import logging
import sys

from pyflink.common import WatermarkStrategy, Encoder, Types
from pyflink.datastream import StreamExecutionEnvironment, RuntimeExecutionMode
from pyflink.datastream.connectors.file_system import FileSource, StreamFormat, FileSink, OutputFileConfig, RollingPolicy

env = StreamExecutionEnvironment.get_execution_environment()
env.set_runtime_mode(RuntimeExecutionMode.BATCH)
# write all the data to one file
env.set_parallelism(1)


ds = env.from_source(
    source=FileSource.for_record_stream_format(StreamFormat.text_line_format(),
                                               './test.csv')
                     .process_static_file_set().build(),
    watermark_strategy=WatermarkStrategy.for_monotonous_timestamps(),
    source_name="aaaa"
)
ds.print()
env.execute()

相关推荐

  1. pyflink 读取excel

    2024-05-01 14:52:01       33 阅读
  2. PyFlink

    2024-05-01 14:52:01       33 阅读
  3. rust calcmine读取excel

    2024-05-01 14:52:01       27 阅读
  4. 读取 Excel 文件

    2024-05-01 14:52:01       20 阅读
  5. pyflink filter

    2024-05-01 14:52:01       27 阅读
  6. pyflink sinktomysql

    2024-05-01 14:52:01       27 阅读

最近更新

  1. docker php8.1+nginx base 镜像 dockerfile 配置

    2024-05-01 14:52:01       94 阅读
  2. Could not load dynamic library ‘cudart64_100.dll‘

    2024-05-01 14:52:01       100 阅读
  3. 在Django里面运行非项目文件

    2024-05-01 14:52:01       82 阅读
  4. Python语言-面向对象

    2024-05-01 14:52:01       91 阅读

热门阅读

  1. FastStone Capture:屏幕捕获与编辑的全能助手

    2024-05-01 14:52:01       44 阅读
  2. useLayoutEffect 和useEffect区别

    2024-05-01 14:52:01       30 阅读
  3. 保障互联网基础:深度解析DNS安全

    2024-05-01 14:52:01       33 阅读
  4. 存在矛盾的题目

    2024-05-01 14:52:01       27 阅读
  5. 【Docker学习】docker run的--annotation选项

    2024-05-01 14:52:01       31 阅读
  6. 泰勒创造力达到顶峰?(下)

    2024-05-01 14:52:01       34 阅读
  7. 美国国防部数据网格参考架构概述(上)

    2024-05-01 14:52:01       30 阅读
  8. Redis 常见的使用场景

    2024-05-01 14:52:01       32 阅读
  9. PCL 在点云中提取其子集点云(点云索引提取)

    2024-05-01 14:52:01       30 阅读
  10. 实验8-13:补全代码,删除字符数组中多个字符

    2024-05-01 14:52:01       29 阅读