Flink error:No data sinks have been created yet. A program needs at least one sink that consumes dat
一、问题描述
Flink程序,批处理程序,执行报错:
Exception in thread "main" java.lang.RuntimeException: No data sinks have been created yet. A program needs at least one sink that consumes data. Examples are writing the data set or printing it.at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:945)at org.apache.flink.api.java.ExecutionEnvironment.createProgramPlan(ExecutionEnvironment.java:923)at org.apache.flink.api.java.LocalEnvironment.execute(LocalEnvironment.java:85)at org.apache.flink.api.scala.ExecutionEnvironment.execute(ExecutionEnvironment.scala:539)at com.bd.flink._1203DataSet.DataSetCounter$.main(DataSetCounter.scala:52)at com.bd.flink._1203DataSet.DataSetCounter.main(DataSetCounter.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at com.intellij.rt.execution.application.AppMain.main(AppMain.java:147)
二、问题原因
没有sink过程,flink执行之前,要求至少一个sink去消费现有的数据。
三、解决问题
添加sink过程即可,注意sink(writeAsText)过程,需要在env执行过程之前:
...val filepath="data//output-scala-count"//默认写到文件result.writeAsText(filepath,FileSystem.WriteMode.OVERWRITE)//执行获得结果resultval jobResult= env.execute("CounterAcc")val num=jobResult.getAccumulatorResult[Long]("ele-counts-scala")
Flink error:No data sinks have been created yet. A program needs at least one sink that consumes dat相关推荐
- 【Flink】No new data sinks have been defined since the last execution
在编写Flink(1.9)批处理任务Demo的时候遇到报错,报错详情: Exception in thread "main" java.lang.RuntimeException: ...
- Error:loading data from ……
解决方法: 我原本不知道怎么回事,参照coco.yaml的文件储存格式把VisDron.yaml的格式改了一下: 原本错误格式:train:images/VisDrone2019-DET-train ...
- Flink学习笔记(一):No new data sinks have been defined since the last execution.
问题描述: 初学flink,在IDEA中写离线批处理的wordcount后,运行报了以下异常: Exception in thread "main" java.lang.Runti ...
- flink报错:No new data sinks have been defined since the last execution
初学flink,在IDEA上编写WordCount代码运行报错如下: Exception in thread "main" java.lang.RuntimeException: ...
- vscode之 wget下载文件报错:ERROR: cannot verify data.vision.ee.ethz.ch‘s certificate
当我在vscode上进行ssh远程连接服务器时,使用wget执行下载文件命令时, wget https://data.vision.ee.ethz.ch/sagea/lld/data/LLD-logo ...
- 小熊开发板STM32工具出现错误Error:an error occured while uploading data from the virtual partition 0xF1
小熊开发板STM32工具出现错误Error:an error occured while uploading data from the virtual partition 0xF1 最近在做小熊派开 ...
- ubuntu Vscode打不开 提示error:unable to write program user data 且多数软件不能正常打开的一种可能性
打开Vscode一直提示error:unable to write program user data,产生如下内容: A system error occurred (listen EACCES: ...
- No new data sinks have been defined since the last execution.
完整报错如下: Exception in thread "main" java.lang.RuntimeException: No new data sinks have been ...
- No new data sinks have been defined since the last execution
报错: Exception in thread "main" java.lang.RuntimeException: No new data sinks have been def ...
最新文章
- excel如果包含某个字就显示_Excel公式基础知识
- 如果你在2018面试前端,那这篇文章最好看一看!
- Python 技术篇 - 用xlrd库和xlwt库操作excel,对excel进行读取和写入实例演示
- 新建/克隆虚拟机(配置)
- 数据湖,当然得要全闪存的!
- mysql5.7.18的安装与主从复制
- oracle数据库基础知识总结,oracle数据库基础知识学习笔记
- 获取京东JDCookie
- fiddler+mitmproxy+夜神模拟器安装
- CC2430基础——定时器1试验
- HGAME2020 签到题ProPlus
- python 优秀的库推荐
- Gdevops峰会北京站归来
- Loding缓存展示的写法-vue3
- 如何使用 DDD 指导微服务拆分?
- 微搭低代码Tab栏组件使用指南
- PHP导出word文档的简单实现方法(可导出图片)
- Docker容器之搭建本地私有仓库
- 《Python 黑科技》一键分析评论关键词,制作精美词云
- bio-linux分区,bio 与块设备驱动
热门文章
- swift kingfisher 加载图片
- MongoDB的聚合函数 Aggregate
- alex学籍注册小程序学习
- UML项目练习-仓库管理系统
- 让控件飞到指定位置动画
- 2017光量子计算机,2017年5月,世界首台光量子计算机在( )诞生
- [转][001] [STM32] 如何下载STM32原厂资料
- 包体积优化·工具论·初识包体积优化
- 教书育人楷模推荐报告_四个在线学习提示,以了解您是否在今年秋天教书
- 中电金信Gien享汇・大数据专题|金融数字化转型与数据应用