Flink docker-compose 单机版 安装教程

介绍

运行模式：

1. Flink Session Cluster
2. Flink Job Cluster
3. Flink Application Cluster

三种集群模式：

1. standalone
2. kubernetes
3. YARN

本文用 配置最简单的 Session Cluster +docker-compose 做演示

配置安装

设置版本环境变量 对应的版本可以看这里

# windows power shell 设置环境 flink 版本环境变量 
$Env:FLINK_DOCKER_IMAGE_NAME="flink:1.14.5-java8"
1
2

编写 docker-compose.yml 带 配置文件挂载

version: "2.1"
services:
  jobmanager:
    image: ${FLINK_DOCKER_IMAGE_NAME:-flink}
    expose:
      - "6123"
    ports:
      - "8081:8081"
    command: jobmanager
    environment:
      - JOB_MANAGER_RPC_ADDRESS=jobmanager
    volumes:
      - E:\docker-mapping\Flink\conf\job\flink-conf.yaml:/opt/flink/conf/flink-conf.yaml

  taskmanager:
    image: ${FLINK_DOCKER_IMAGE_NAME:-flink}
    expose:
      - "6121"
      - "6122"
    depends_on:
      - jobmanager
    command: taskmanager
    links:
      - "jobmanager:jobmanager"
    environment:
      - JOB_MANAGER_RPC_ADDRESS=jobmanager
    volumes:
      - E:\docker-mapping\Flink\conf\task\flink-conf.yaml:/opt/flink/conf/flink-conf.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28

把配置文件放在 本地挂载的目录flink-conf.yaml

jobmanager.rpc.address: jobmanager
jobmanager.rpc.port: 6123
jobmanager.memory.process.size: 4096m
taskmanager.memory.process.size: 16384m
taskmanager.numberOfTaskSlots: 10
parallelism.default: 1
jobmanager.execution.failover-strategy: region
blob.server.port: 6124
query.server.port: 6125
1
2
3
4
5
6
7
8
9

启动

docker-compose.exe -f E:\docker-mapping\Flink\docker-compose.yml up -d
1

最后

浏览器打开 Apache Flink Dashboard

http://localhost:8081/#/overview
1