Gauss Boot

Appearance

TIDB DM 组件安装 ​

安装tiup ​

curl --proto '=https' --tlsv1.2 -sSf https://tiup-mirrors.pingcap.com/install.sh | sh

安装dm和dmctl ​

tiup install dm dmctl

部署dm master和worker ​

配置文件 ​

#topology.yaml
global:
  user: "tidb"
  ssh_port: 22
  deploy_dir: "/dm-deploy"
  data_dir: "/dm-data"

server_configs:
  master:
    log-level: info
    # rpc-timeout: "30s"
    # rpc-rate-limit: 10.0
    # rpc-rate-burst: 40
  worker:
    log-level: info

master_servers:
  - host: 10.108.132.40
    port: 8261
    name: master1
    config:
      log-level: info
      # rpc-timeout: "30s"
      # rpc-rate-limit: 10.0
      # rpc-rate-burst: 40

worker_servers:
  - host: 10.108.132.40
    port: 8262
    config:
      log-level: info
      # keepalive-ttl: 60
      # relay-keepalive-ttl: 1800 # since v2.0.2
      # relay-dir: "" # since v5.4.0

monitoring_servers:
  - host: 10.108.132.40
    port: 19090
grafana_servers:
  - host: 10.108.132.40
    port: 13000
alertmanager_servers:
  - host: 10.108.132.40
    web_port: 19093

执行部署命令 ​

tiup dm deploy dm-test v6.5.0  topology.yaml --user root -p

创建数据源 ​

配置 ​

#goms.yaml
source-id: "mysql-goms"
enable-gtid: false
from:
  host: "10.108.110.108"         # 例如：172.16.10.81
  user: "saaf"
  password: "fQAnZht7mKsV"
  port: 3306

创建数据源 ​

tiup dmctl --master-addr 10.108.132.40:8261  operate-source create goms.yaml

移除数据源 ​

tiup dmctl --master-addr 10.108.132.40:8261  operate-source stop goms.yaml

查询数据源 ​

tiup dmctl --master-addr 10.108.132.40:8261  operate-source show goms.yaml

创建任务 ​

配置文件 ​

# task-goms.yaml
name: "goms"
# 任务模式，可设为
# full：只进行全量数据迁移
# incremental： binlog 实时同步
# all： 全量 + binlog 迁移
task-mode: "full"
target-database:
  host: "10.108.132.40"
  port: 4000
  user: "root"
  password: "password"

mysql-instances:
- source-id: "mysql-goms"
  block-allow-list: "rules-goms"


block-allow-list:
  rules-goms:
    do-dbs: ["dmp_sales_order"]
    do-tables:
    - db-name: "dmp_sales_order"
      tbl-name: "~^ims_ec_sales_order.*"

验证任务 ​

tiup dmctl --master-addr 10.108.132.40:8261 check-task task-goms.yaml

创建任务 ​

tiup dmctl --master-addr 10.108.132.40:8261 create-task task-goms.yaml

执行任务 ​

tiup dmctl --master-addr 10.108.132.40:8261 start-task --remove-meta  task-goms.yaml

取消任务 ​

tiup dmctl --master-addr 10.108.132.40:8261 stop-task task-goms.yaml

查询状态 ​

tiup dmctl --master-addr 10.108.132.40:8261 query-status goms