http://tangzhongham.github.io/flink/ Recent content in Flinks on Mytopia Hugo -- gohugo.io Mon, 08 Jun 2020 16:59:22 +0800 http://tangzhongham.github.io/flink/flink%E6%BA%90%E7%A0%81%E9%98%85%E8%AF%BB%E4%B9%8B%E4%BB%BB%E5%8A%A1%E6%8F%90%E4%BA%A4%E6%B5%81%E7%A8%8B/ Mon, 08 Jun 2020 16:59:22 +0800 http://tangzhongham.github.io/flink/flink%E6%BA%90%E7%A0%81%E9%98%85%E8%AF%BB%E4%B9%8B%E4%BB%BB%E5%8A%A1%E6%8F%90%E4%BA%A4%E6%B5%81%E7%A8%8B/ Flink 源码阅读之任务提交基本流程 org.apache.flink.runtime.blob.BlobServer#run java.net.ServerSocket#accept BlobServer.run 涉及的类: org.apache.flink.client.cli.CliFrontend org.apache.flink.client.ClientUtils org.apache.flink.streaming.examples.wordcount.WordCount org.apache.flink.runtime.blob.BlobServer#run org.apache.flink.runtime.taskexecutor.TaskExecutor#submitTask org.apache.flink.runtime.deployment.TaskDeploymentDescriptor 流程准备 以远程调试模式运行 org.apache.flink.client.cli.CliFrontend org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint org.apache.flink.runtime.taskexecutor.TaskManagerRunner 使用 ./flink 提交 WordCount.jar, 查看整个任务的流转过程 org.apache.flink.client.program.PackagedProgram#callMainMethod java.lang.reflect.Method#invoke org.apache.flink.streaming.api.environment.StreamContextEnvironment#execute org.apache.flink.streaming.api.graph.StreamGraphGenerator#generate org.apache.flink.streaming.api.graph.StreamGraphGenerator#transform org.apache.flink.streaming.api.environment.StreamExecutionEnvironment#executeAsync(org.apache.flink.streaming.api.graph.StreamGraph) org.apache.flink.core.execution.JobListener#onJobSubmitted org.apache.flink.client.program.rest.RestClusterClient#submitJob JM http://tangzhongham.github.io/flink/flink%E6%BA%90%E7%A0%81%E9%98%85%E8%AF%BB%E4%B9%8B%E5%90%AF%E5%8A%A8%E6%B5%81%E7%A8%8B/ Mon, 08 Jun 2020 16:57:43 +0800 http://tangzhongham.github.io/flink/flink%E6%BA%90%E7%A0%81%E9%98%85%E8%AF%BB%E4%B9%8B%E5%90%AF%E5%8A%A8%E6%B5%81%E7%A8%8B/ Flink源码阅读之启动流程 本文分析了 Flink standalone/yarn 的启动流程 先看启动脚本 start-cluster.sh ## 读取默认 config 配置文件 . "$bin"/config.sh # Start the JobManager instance(s) ## 用来定制 shell 环境 -s 开启某个选项 nocasematch 忽略大小 http://tangzhongham.github.io/flink/intro/ Mon, 01 Jun 2020 17:03:23 +0800 http://tangzhongham.github.io/flink/intro/ haha